-- Logs begin at Wed 2022-05-04 20:41:47 UTC, end at Wed 2022-05-04 22:05:10 UTC. -- May 04 21:25:11.867967 dv-cinder-836083-5-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 04 21:25:11.878127 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 4 21:25:11 2022] *** May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: nodename: dv-cinder-836083-5-iscsi May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: machine: x86_64 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: clock source: unix May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: pcre jit disabled May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: detected number of CPU cores: 4 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: current working directory: / May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: detected binary path: /usr/bin/uwsgi-core May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: your processes number limit is 47680 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: your memory page size is 4096 bytes May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: detected max file descriptor number: 2048 May 04 21:25:11.880211 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: lock engine: pthread robust mutexes May 04 21:25:11.880960 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: thunder lock: enabled May 04 21:25:11.881485 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 04 21:25:11.881578 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 04 21:25:11.927814 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: Python main interpreter initialized at 0x56154add59c0 May 04 21:25:11.927814 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: python threads support enabled May 04 21:25:11.927814 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: your server socket listen backlog is limited to 100 connections May 04 21:25:11.927814 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: your mercy for graceful operations on workers is 90 seconds May 04 21:25:11.928171 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: mapped 403077 bytes (393 KB) for 2 cores May 04 21:25:11.928382 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: *** Operational MODE: preforking *** May 04 21:25:11.928580 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: *** uWSGI is running in multiple interpreter mode *** May 04 21:25:11.928580 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: spawned uWSGI master process (pid: 79960) May 04 21:25:11.928791 dv-cinder-836083-5-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 04 21:25:11.929680 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: spawned uWSGI worker 1 (pid: 80010, cores: 1) May 04 21:25:11.929680 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: spawned uWSGI worker 2 (pid: 80011, cores: 1) May 04 21:25:11.929892 dv-cinder-836083-5-iscsi devstack@keystone.service[79960]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 04 21:25:17.595417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:25:17.595417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: from cryptography.utils import int_from_bytes May 04 21:25:17.596203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:25:17.596203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: from cryptography.utils import int_from_bytes May 04 21:25:17.598667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:25:17.598667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: from cryptography.utils import int_from_bytes May 04 21:25:17.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 04 21:25:17.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: from cryptography.utils import int_from_bytes May 04 21:25:17.645875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 21:25:17.646050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 04 21:25:17.646050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 21:25:17.646205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 04 21:25:17.646273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] command line args: [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 21:25:17.646348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] command line args: [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 04 21:25:17.646593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 21:25:17.646682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 04 21:25:17.646743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ================================================================================ {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 21:25:17.646800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ================================================================================ {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 04 21:25:17.646869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] admin_token = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.646935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] admin_token = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] config_dir = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] config_dir = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] config_source = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] config_source = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] debug = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] debug = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.647811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650638 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.650998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_config_append = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_config_append = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_dir = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_dir = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_file = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_file = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.651994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.652967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.23/identity {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] publish_errors = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] publish_errors = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.653903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.654696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.654910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.655214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.655517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.655722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.655884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.656079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] standard_threads = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.656274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] standard_threads = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.656509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.656685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.656877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.657062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.657255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.657449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.657644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] use_journal = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.657836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] use_journal = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] use_json = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] use_json = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] use_stderr = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] use_stderr = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] use_syslog = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.658974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] use_syslog = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.659187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.659497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 04 21:25:17.659720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.659904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.660894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.661986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.662994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.663919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.664983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.665876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.666920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.667960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.668882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.669777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.670941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.671877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.672009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.673359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.673570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.673732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.673921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.674146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.674306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.674497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.674683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.674867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.675051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.675243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.675482 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.675707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.675910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.676120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.676284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.676477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.676667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.676853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.677989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.678962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.679956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.680875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.681934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.682975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.683919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.684954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.685867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.686995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.687959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.688985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.689885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.external = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.690900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.691035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.external = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.691189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.password = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.691335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.691749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] auth.token = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.691885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.password = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] auth.token = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.692916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.693974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.694885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.695991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.696879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.697928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.698991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.699119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.699245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.699394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.699751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.699963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.700878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.701962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.702898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.703704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.704883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.705914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.706962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.707914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.708967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.709999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.710920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.711876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.712924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.713955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.714982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.715893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.716937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.717063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.717189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.717332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.717460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.717659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.718876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.719971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.720879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.721779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.722883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.723796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.724810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.725749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.726866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] role.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.727911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] role.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.728942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] role.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] role.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.729962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.730869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.731970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.732920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.733883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.734958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.735902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.736988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.737951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.738992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.739937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.740973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.connection = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.741878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.742934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.connection = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.743871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.744931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.745971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80011) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 04 21:25:17.746851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80010) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 04 21:25:17.761543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.761856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.761856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.762132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.762262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.762395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.771224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.771598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.801185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.801410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.802800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.803184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.855532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.855715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.908144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.908347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.908753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.908984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.974494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.974681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.974766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.974867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.974946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.975675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.998606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.998755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.998917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:17.999888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.000014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.000111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.011100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.011452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.025722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.025892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.026924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80010) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.027014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.027136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80011) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 04 21:25:18.044115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.044286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:25:18.044649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.044773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.044875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:25:18.044956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:25:18.045101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.045225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.045320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.045399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 04 21:25:18.045575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.045700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.045906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.046047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.046175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.046434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.056804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.057927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.058093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.065644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.066166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.068903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.069177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.069454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.069713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.069894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.070939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.071864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.072157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.072434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.098061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.098869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.099670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.099943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.100486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.100761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.105131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.105400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.105732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.105936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.106239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.106508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.112963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.113234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.113748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.113998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.117796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.118083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.118352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.118533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.118687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.118817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.118942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.119860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.120136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.120368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.138032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.138304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.138851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.139119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.142852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.143699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.146524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.146814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.147259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.147578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.151744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.152475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.155284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.156052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.158978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.159246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.159556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.159737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.159872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.159998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.160211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.160350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.160477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.160601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.160767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.161061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.179414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.179771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.180035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.180214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.180368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.180509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.180721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.180981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.188112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.188785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.189804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.190069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.190474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.190744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.193100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.193372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.193661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.193864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.194004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.194132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.194266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.194393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.194590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.194859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.207487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.207732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.208371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.208885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.209008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.209132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.209267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.209481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.209757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.228545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.228747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.231147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.231751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.234578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.235295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.236092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.239348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.239348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.239571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.239639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.239844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.244283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.244283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.245617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.247202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.247761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.249380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.250452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.253455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.260377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.260668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.260995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.262511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.262801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.263076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.268880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80011) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.269115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.269418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.269702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.269969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.270234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.270507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.270858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.270976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80010) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 04 21:25:18.271139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.271882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80011) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.272854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.273118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.273347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.273647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.273910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.274171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.274413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80010) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 04 21:25:18.310914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56154add59c0 pid: 80011 (default app) May 04 21:25:18.312706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56154add59c0 pid: 80010 (default app) May 04 21:25:18.314443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8899fb-c2ae-4839-a30c-d1d717c15f6c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:18.314747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8899fb-c2ae-4839-a30c-d1d717c15f6c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:18.315026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8899fb-c2ae-4839-a30c-d1d717c15f6c None None] PATH_INFO: `/v3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:18.319184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 791 bytes} [Wed May 4 21:25:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:26.265890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:26.266362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:26.266460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:26.270755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:26.276313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:26.276744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:26.276833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:26.307794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG oslo_db.sqlalchemy.engines [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80011) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 21:25:26.491469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG passlib.handlers.bcrypt [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80011) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 21:25:26.491909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG passlib.handlers.bcrypt [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80011) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 21:25:26.546404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:26.547997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:26.671372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 2/3] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 04 21:25:26.858588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:26.893643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG oslo_db.sqlalchemy.engines [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80010) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 04 21:25:27.023400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c97132-c5e4-452d-bbd9-c19a236480d7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:27.028167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:27.028823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:27.029101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:27.029372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:27.037594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:27.088440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 21:25:27.088776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8aca61-0032-4fc7-9cb2-fc9bed72b07b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:27.098662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1324 bytes} [Wed May 4 21:25:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:25:27.104637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:27.119259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc6e2c-13c3-49fd-b4d2-6caa1f8ee6e9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:27.125013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:27.126136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:27.126423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:27.126699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] PATH_INFO: `/v3/projects/69a58d85914b42b5b2db98febd6721c4` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:27.128365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] RBAC: Authorizing `identity:get_project(project_id=69a58d85914b42b5b2db98febd6721c4)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:27.178549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 04 21:25:27.178891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8d882-cb04-41e5-bc33-bda646ea6c37 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:27.183539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 3/5] 10.222.0.23 () {56 vars in 1207 bytes} [Wed May 4 21:25:27 2022] GET /identity/v3/projects/69a58d85914b42b5b2db98febd6721c4 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:29.378554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de19fb-2ea7-4406-9bf1-d0508fc911c2 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:29.379098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de19fb-2ea7-4406-9bf1-d0508fc911c2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:29.379098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de19fb-2ea7-4406-9bf1-d0508fc911c2 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:29.383358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 3/6] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:29.389993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:29.390437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:29.390563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:29.412368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:29.413882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:29.424497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 04 21:25:29.458749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de19fb-2ea7-4406-9bf1-d0508fc911c2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:29.479740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de19fb-2ea7-4406-9bf1-d0508fc911c2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:29.486226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:29.486853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:29.487131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:29.487412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:29.495711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:29.497489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9e6dd-b96f-4361-bc8b-0bb5b5a75e91 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:29.506428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1324 bytes} [Wed May 4 21:25:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:25:29.512878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:29.522685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533ad7-7221-4e42-90ea-40f18e44f906 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:29.527981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:29.528841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:29.529120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:29.529388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:29.530903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:29.532753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04b13c-d580-4444-bbf9-e5aa1ba26ddd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:29.534353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 5/9] 10.222.0.23 () {56 vars in 1198 bytes} [Wed May 4 21:25:29 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:31.827364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432452-d72f-4309-9ce6-1537df05cf88 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:31.827975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432452-d72f-4309-9ce6-1537df05cf88 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:31.827975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f432452-d72f-4309-9ce6-1537df05cf88 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:31.829298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:31.834539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:31.834941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:31.835205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:31.851710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f907-9796-4c6f-8c4e-5034b4013b6c None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:31.852344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f907-9796-4c6f-8c4e-5034b4013b6c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:31.852773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1f907-9796-4c6f-8c4e-5034b4013b6c None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:31.855088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 6/11] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:31.863570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:31.863862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:31.864137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:31.905320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG passlib.handlers.bcrypt [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80010) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 04 21:25:31.905723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG passlib.handlers.bcrypt [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80010) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 04 21:25:31.952339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:31.953953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:31.969669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:31.970817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:32.049796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:32.055478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:32.073487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.079902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.168493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1880b-6ca3-4a81-9822-1f264012d33d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.178264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aab165-a41c-47ce-a7e0-854ed7276f49 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.201642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.202451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.202725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.202999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.211631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.212518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.212801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.213079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.213858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:32.225227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:32.226369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:32.227231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 7/14] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:25:32.232638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.279863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.281397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.327809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab598-e89c-46ca-9363-496f9b959523 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.360014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.360628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.360901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.361171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.361913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:32.362215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.363620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.374365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:32.375116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 8/16] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:32.380060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.380611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.476453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836bb6d-17f6-4f63-841b-8a9910f571fb None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.476639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dad983-e75f-4e27-9e9d-d6950a8e92d8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.509608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.510400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.510680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.510804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.510931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.511569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.511844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.512112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.513285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.514780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.516369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 9/17] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:32.521980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.628422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55691de-50b0-4b14-9cfd-9d6437c510d1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.638441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.639999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:25:32.660772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:32.661670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:32.662456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:25:32.662456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:25:32.662456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:25:32.662456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:32.662456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 9/18] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:25:32.669869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.670329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.670719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.670995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.671240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.672932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.674381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.676045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 10/19] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:32.681617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:32.765837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008473-dccd-4033-a486-280b24cb73f1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.779284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cad79-4f3d-41ab-bd24-26d053cdc2cc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:32.796662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.797318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.797594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.797863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.798560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:32.798856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.800315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254f679-db4a-42e6-923c-fe79fb3fec10 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.813647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:32.814300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:32.814583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:32.814855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:32.815730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.domain.id=default, user.id=f6c818d1963e4410bafbf00912c084aa) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:32.816038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:32.817185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 10/20] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:32.817505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f4731-a3fb-46e6-b2f8-e56eea6ce777 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:32.824809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 11/21] 10.222.0.23 () {56 vars in 1322 bytes} [Wed May 4 21:25:32 2022] GET /identity/v3/role_assignments?user.id=f6c818d1963e4410bafbf00912c084aa&scope.domain.id=default&role.id=1af302468b924833a9aea028857eac8d => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:35.351578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376303-cc3d-4965-9dde-dd911bb28559 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.352569 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376303-cc3d-4965-9dde-dd911bb28559 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.353076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42376303-cc3d-4965-9dde-dd911bb28559 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.354668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 11/22] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:35.360660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.361642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.362280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.365913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86780fc-4bad-40cb-9e59-b9ca81b3ab76 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.366933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86780fc-4bad-40cb-9e59-b9ca81b3ab76 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.368647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86780fc-4bad-40cb-9e59-b9ca81b3ab76 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.372283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 12/23] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:35.375728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.381425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.381947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.400469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:35.402011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:35.410481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:35.411984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:35.506531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 12/24] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:35.545034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 13/25] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:35.550763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:35.579198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:35.726862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945740ae-d0be-4951-866b-0893b17e0837 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:35.800658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:35.801363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.801685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.807466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.807466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:35.807466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082a66d-0489-4986-b611-4e384cff869f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:35.863706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22c24f-df28-43ce-94a1-fb01b5c2acc6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:35.938137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:35.939105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.939438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.939755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:35.972515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-939b69c0-e9d0-461c-921d-fbc9df7e09ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:35.982688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:35.983821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:35.985346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:35.996677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 14/26] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:25:35.998049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadfbdf-faef-4a4e-ae61-558354888da3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:35.998338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadfbdf-faef-4a4e-ae61-558354888da3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:35.998621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadfbdf-faef-4a4e-ae61-558354888da3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.000237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 15/27] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:36.002437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadfbdf-faef-4a4e-ae61-558354888da3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.057542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 13/28] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 21:25:35 2022] POST /identity/v3/roles => generated 219 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:36.059703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a066-ec9f-46b8-a6e5-7e50988431da None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.060207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a066-ec9f-46b8-a6e5-7e50988431da None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.060638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5a066-ec9f-46b8-a6e5-7e50988431da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.117497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9cb5a066-ec9f-46b8-a6e5-7e50988431da None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:36.120455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9cb5a066-ec9f-46b8-a6e5-7e50988431da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:36.232185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadfbdf-faef-4a4e-ae61-558354888da3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.267677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 14/29] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:36.269181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5cdb-773e-4ae4-aa91-61153a747432 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.269597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5cdb-773e-4ae4-aa91-61153a747432 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.269990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee5cdb-773e-4ae4-aa91-61153a747432 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.273086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:36.278127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.278412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.278694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.283020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.283886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.284304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.284714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.285599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:36.286150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.287711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.300351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 16/31] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:36.301401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.312915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:36.314227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:36.383631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 16/32] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:36.385442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.400174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d28d32-f1ff-4d11-8e0a-f9d7738de69c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.433800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.434606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.434879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.435151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.445810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.447334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:25:36.466342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:36.467204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:36.468485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:25:36.468485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:25:36.468485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:25:36.468485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:36.468485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 17/33] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:36.469210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.493471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c14a2-c91d-4cba-83b7-8d5a258512c1 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.529162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.530567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.531051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.531586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.533022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.534888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.537276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 17/34] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:36 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:36.538241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.572624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc384976-68b2-4d63-8bdf-57508987de28 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.607476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.608185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.608474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.608747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.609507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.611591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.648473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32d9f1-c35d-4959-9d84-47faf0b9fbb8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.688873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.689545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.689872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.690147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.690936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:36.691244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.692718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.710664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 18/35] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:36.711520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.743930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 18/36] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 21:25:36 2022] POST /identity/v3/roles => generated 225 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:36.745194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.833139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfda19b-6407-4a4a-aefd-a1084443c990 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.848868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a830414-4b8b-43bf-a7ba-0a5783ccc918 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:36.879667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.880636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.880936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.881213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.883103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.884857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.886672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 19/37] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:36.887566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:36.888547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:36.889018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:36.889516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:36.890687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:36.892532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4cc7a-9c33-4671-a3ab-af5ee30db5c1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:36.892788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:36.956142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 19/38] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:25:36 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:37.028021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e5812-4d7a-4932-b3cf-13fbf9c47b6b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:37.072289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:37.073217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.073505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.073797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] PATH_INFO: `/v3/domains/default/users/f6c818d1963e4410bafbf00912c084aa/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.076246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f6c818d1963e4410bafbf00912c084aa, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:37.077834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:37.078193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae807-1adf-4ebe-b63b-4423dd4b9771 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.078490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae807-1adf-4ebe-b63b-4423dd4b9771 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.078772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae807-1adf-4ebe-b63b-4423dd4b9771 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.080496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 20/39] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:37.086456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1971d-6521-4af9-9a69-6c336eb9c726 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.087098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1971d-6521-4af9-9a69-6c336eb9c726 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.087641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1971d-6521-4af9-9a69-6c336eb9c726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.105459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 20/40] 10.222.0.23 () {58 vars in 1361 bytes} [Wed May 4 21:25:36 2022] PUT /identity/v3/domains/default/users/f6c818d1963e4410bafbf00912c084aa/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:25:37.111783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-abe1971d-6521-4af9-9a69-6c336eb9c726 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:37.113308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-abe1971d-6521-4af9-9a69-6c336eb9c726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:37.199803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 21/41] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:37.224486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:37.288625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755a16-5d0a-4a56-8980-3b58875f875d None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.288918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755a16-5d0a-4a56-8980-3b58875f875d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.289203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53755a16-5d0a-4a56-8980-3b58875f875d None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.290957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 22/42] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:37.296490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.296782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.297069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.318867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:37.320621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:37.347066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7215df-1931-42e9-b456-42d7e8e7a506 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:37.383225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:37.383995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.384535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.384605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.385341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:37.386845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:37.398918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 23/43] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:37.401345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 21/44] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 21:25:37 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:37.422427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:37.530564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b95fc2-7ae9-4d92-8cce-11a59d024ff8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:37.568186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:37.569047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.569347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.569630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.570911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:37.572539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e27eb-6ce2-408b-8d62-1f8dc6c7321e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:37.574516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 24/45] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:37.580449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:37.680819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84f6c0-6791-409c-ba07-5b86db53656c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:37.713228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:37.713890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:37.714140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:37.714436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:37.715153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:37.716643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d96cb-85f4-4c33-bdc5-38d5dd7f0992 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:37.744462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 22/46] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:25:37 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:39.422259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35703-9a3e-4cf7-8c68-cb610dec644c None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.422795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35703-9a3e-4cf7-8c68-cb610dec644c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.422795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d35703-9a3e-4cf7-8c68-cb610dec644c None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.424199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 25/47] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:39.429733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.430126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.430295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.447664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:39.448853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:39.519029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 23/48] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:39.541701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35703-9a3e-4cf7-8c68-cb610dec644c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:39.641847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d35703-9a3e-4cf7-8c68-cb610dec644c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:39.677279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:39.678075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.678351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.678621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.689089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:39.696620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:39.697576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:39.698356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 26/49] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:39.705375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:39.810760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f015c2-be31-4014-8918-bb59c085a282 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:39.852362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:39.853064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.853360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.853706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.854470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:39.854778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:39.856204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de9db4-7661-40a3-b7b5-6f930faa2732 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:39.864571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 24/50] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:39.870068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:39.965410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a2bb-3692-4c77-aa32-d0559b0c53eb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.965653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a2bb-3692-4c77-aa32-d0559b0c53eb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.965944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4a2bb-3692-4c77-aa32-d0559b0c53eb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.967308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 25/51] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:39.972623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:39.972861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5b8c6-849a-4859-b588-bffc6fe3ca00 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:39.972985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:39.973178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:39.990423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:39.991642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:40.008060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:40.008957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:40.009240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:40.009518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:40.010957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:40.012471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:40.014141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 27/52] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:39 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:40.019680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:40.057675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:40.080647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:40.116794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dd97c-a1c2-4539-8f08-fe1e60f326c1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:40.149864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:40.150645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:40.150921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:40.151187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:40.152421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:40.153844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:40.155496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 28/54] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:40.161236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:40.176865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7fdae-799e-43ba-9dc5-f2d8af935d84 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:40.209432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:40.210226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:40.210512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:40.210793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:40.212061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:40.213509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:40.215127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:40.220958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:40.256239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10cc64-8085-4935-9bd3-11d95785e431 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:40.287709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:40.288360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:40.288643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:40.288921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:40.289854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.domain.id=default, user.id=f6c818d1963e4410bafbf00912c084aa) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:40.290201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:40.291664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e4949-121f-48b0-a4a7-8200cc0dea33 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:40.300223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 29/56] 10.222.0.23 () {56 vars in 1322 bytes} [Wed May 4 21:25:40 2022] GET /identity/v3/role_assignments?user.id=f6c818d1963e4410bafbf00912c084aa&scope.domain.id=default&role.id=1af302468b924833a9aea028857eac8d => generated 530 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:40.315589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8f2ed-6b17-40a8-b8a9-fa1f59f06b95 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:40.353114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:40.353670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:40.353976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:40.354250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:40.354977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:40.356500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07d85ed-d46c-4e4f-95a2-8380060adb56 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:40.384037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 28/57] 10.222.0.23 () {60 vars in 1140 bytes} [Wed May 4 21:25:40 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:25:42.600859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250123-18a3-476c-b7b8-ebc0ea279cc7 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:42.601657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250123-18a3-476c-b7b8-ebc0ea279cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:42.601830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab250123-18a3-476c-b7b8-ebc0ea279cc7 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:42.604004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 30/58] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:42.612711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:42.613114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:42.613331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:42.634930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:42.636139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:42.703005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 29/59] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:42.727676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250123-18a3-476c-b7b8-ebc0ea279cc7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:42.829075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab250123-18a3-476c-b7b8-ebc0ea279cc7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:42.864154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:42.864875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:42.865159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:42.865434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:42.866748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:42.868242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d827ad-5300-402d-92c9-aae650cc5b34 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:42.869855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 31/60] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:42.876208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:42.979648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530187c-70f5-4763-8303-100d0945cb4e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:43.013556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:43.014277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:43.014565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:43.014834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:43.015576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:43.017032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19350ecc-0808-4745-a537-d6f7444f5ddb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:43.048709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 30/61] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:25:42 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:46.220089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6cb-0c48-4cf5-93b3-4d2aafdcda09 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.221118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6cb-0c48-4cf5-93b3-4d2aafdcda09 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.221593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2a6cb-0c48-4cf5-93b3-4d2aafdcda09 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.223466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 32/62] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:46.228424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.229256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.229730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.254065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:46.255774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:46.342065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 31/63] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:46.372343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2a6cb-0c48-4cf5-93b3-4d2aafdcda09 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:46.496026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2a6cb-0c48-4cf5-93b3-4d2aafdcda09 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:46.532185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:46.532990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.533266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.533536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.548111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-c4098594-bcd4-4ee6-9cc4-4bc48e21ddb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:46.555661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:46.556490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:46.557686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 33/64] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:46.562686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:46.633931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94f3f-311c-48e3-bd44-132a461c1f30 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.634246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94f3f-311c-48e3-bd44-132a461c1f30 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.634478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94f3f-311c-48e3-bd44-132a461c1f30 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.636044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 34/65] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:46.645061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9576-7a93-428c-8286-13879ed30cbb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.645341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9576-7a93-428c-8286-13879ed30cbb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.645617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9576-7a93-428c-8286-13879ed30cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.672032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3bde9576-7a93-428c-8286-13879ed30cbb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:46.673242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3bde9576-7a93-428c-8286-13879ed30cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:46.717219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54609a-6178-4677-b8a0-7a73de7e30f5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:46.759579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:46.760470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.760993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.761413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.762300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:46.762735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:46.764352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:46.772903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 32/66] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:46.778260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:46.805298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 35/67] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:46.806859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22d-5e4d-4c11-8c51-43e8af9eb885 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.807284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22d-5e4d-4c11-8c51-43e8af9eb885 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.808155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307b22d-5e4d-4c11-8c51-43e8af9eb885 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.809912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 36/68] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:46.815225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.815540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.815816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.841582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:46.843831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:46.912291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673de4c8-0e87-4220-b573-89e46bbd229a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:46.928248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 37/69] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:46.930903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:46.963168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:46.965494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:46.966145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:46.967943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:46.985308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:46.987189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:46.989882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 33/70] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:46 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:46.990934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.055893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f102d38-d1c6-41b0-8977-561d6eb4a2dc None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.092254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.093490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.093775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.094052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.094307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314ba9c-182e-4fe0-98a8-894b7e24a39b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.104490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:47.112253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:47.113146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:47.113914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 38/71] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:47.114523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.128479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.129295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.129575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.129845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.139589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-01a09628-1af3-4c3e-8a5e-b8af9c50a146 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:47.147487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:47.148475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:47.149526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 34/72] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:25:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:47.150326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dfaa6-30a1-4589-94af-3296fd570f59 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.150480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dfaa6-30a1-4589-94af-3296fd570f59 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.150698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dfaa6-30a1-4589-94af-3296fd570f59 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.152003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 35/73] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:47.153057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43110c-17f9-42dc-8024-93daf2d05775 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.153337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43110c-17f9-42dc-8024-93daf2d05775 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.153616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43110c-17f9-42dc-8024-93daf2d05775 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.154941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 36/74] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:47.158156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43110c-17f9-42dc-8024-93daf2d05775 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.212068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8d305-a83e-4df8-b722-44063e57310d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.245003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.245642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.245923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.246217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.254927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43110c-17f9-42dc-8024-93daf2d05775 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.287519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.288183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.288486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.288761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.289512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:47.289817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.291232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.300111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.310286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.311756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee5076-a7b9-4e0c-9d78-32f75884c38b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.394705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813c737-5774-4059-bdc9-505ef8248488 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.406994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 39/76] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:47.409162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.409454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.409714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.426066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:47.426530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.427198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.427287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:47.427510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.427788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.428543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:47.428848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.430225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d677a-d6dd-4646-af18-3ec4f8dd1614 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.437971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 38/77] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.439884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.440167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.440428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.456797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:47.457958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:47.493631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:47.494488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.529179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:47.529179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.588751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfbc08-08aa-41ef-836c-f24724d1f331 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.623030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.624394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.624778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.625234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.627018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.629160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.631018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 41/80] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.631609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.632949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101808c-d695-4a45-bf4b-c1fa4ce4215a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.665653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.666511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.666786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.667054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.668282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.669718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.671776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 40/81] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.672534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.724823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a84cf78-d508-414f-a071-03fcf38c9e31 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.756862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.757740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.758023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.758305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.759578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.761051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.762681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 42/82] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.763429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.769124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8d1899-d6ab-47c8-a383-73bace766608 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.801706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.802501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.802780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.803047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.813026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:47.820622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:47.821639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:47.822395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 41/83] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:47.824181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.860251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2bda35-3571-458f-83c8-037a27301bcb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.890816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.891626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.891903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.892171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.893361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:47.894786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:47.896404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 43/84] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:47.897143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:47.921752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2c4e4-5016-4258-b6ac-41c2663f3ca6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:47.952696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:47.953338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:47.953620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:47.953890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:47.991909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484b5eb-c9cf-41f5-98cf-2bd99391694c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.018885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.020416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.024144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.024788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.025072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.025350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.026175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:48.026488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.027952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.034277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 44/85] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.035279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.140706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00608b83-12d5-4c67-a249-e6c0932b417b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.142156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 42/86] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:48.147026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.179268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.180266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.180714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.181240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.243312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d36b4f7-a008-4f6e-95d6-1e7ce89f09dd None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.252311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.254430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.277358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.278026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.278310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.278585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.279338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:48.279677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.281091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.293851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 43/87] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.293851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.349999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:48.350857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.383757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7cb7-f298-49c5-96cf-d69febc7f8e9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.415079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.415740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.416016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.416288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.416994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.418440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.438609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 44/89] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:25:48 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:48.439459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.442930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb8bb-1c55-4e6e-8830-a760182d6f9b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.484026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.485756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.486296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.486790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.488693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.490366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.493241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 46/90] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.494169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.572930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9831118-0013-46ce-a259-c1747e2c31de None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.600589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873235a1-a504-43b0-adb7-a302fed566cd None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.617217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.618269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.618848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.619132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.620412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.622349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.624732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 45/91] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.626103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.636938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.637804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.638089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.638360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.639710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.641262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.642994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 47/92] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.644537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.733823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03977d6-c0d5-4d98-bbfd-db292de2f27f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.761865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6ab90-27c3-445f-9ef8-cc7fe564629b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.768244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.769199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.769681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.770159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.771200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=f6c818d1963e4410bafbf00912c084aa) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:48.771741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.773419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.779459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 46/93] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/role_assignments?user.id=f6c818d1963e4410bafbf00912c084aa&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:48.780561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:48.801752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.802792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.803079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.803356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.887623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad83535-be71-40a6-b9a6-4911e027bb2c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:48.888037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.889689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.925722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:48.926398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:48.926681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:48.926958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:48.927943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:48.928259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:48.929767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:48.936211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 47/94] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=3f129043517b4e948ef87a9befee7394 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:49.003673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 48/95] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:49.011519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:49.155452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e61d66-7e51-4e9d-9993-6882517287f9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:49.201108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:49.202031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:49.202314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:49.202591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] PATH_INFO: `/v3/projects/13e26cf7217240689c4fc2365db3894e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:49.203886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] RBAC: Authorizing `identity:get_project(project_id=13e26cf7217240689c4fc2365db3894e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:49.205345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e0472-857e-4950-b314-a10a49d4436b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:49.207070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 48/96] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:49 2022] GET /identity/v3/projects/13e26cf7217240689c4fc2365db3894e => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:49.214984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:49.348345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648835f-886b-4dd4-8a7c-cc573f321a91 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:49.381662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:49.382328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:49.382613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:49.382890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:49.383753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=13e26cf7217240689c4fc2365db3894e, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:49.384068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:49.385523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8b3ed-027a-4b84-95be-2150fe580b21 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:49.391290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 49/97] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:49 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=13e26cf7217240689c4fc2365db3894e&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:50.747860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d2e9-02ed-45cc-99bf-a1cde0d6e1ac None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:50.748453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d2e9-02ed-45cc-99bf-a1cde0d6e1ac None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:50.748453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369d2e9-02ed-45cc-99bf-a1cde0d6e1ac None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:50.749879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 49/98] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:50.755275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:50.755702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:50.755885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:50.779648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:50.780922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:50.875972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 50/99] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:50.933080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369d2e9-02ed-45cc-99bf-a1cde0d6e1ac None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.067718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369d2e9-02ed-45cc-99bf-a1cde0d6e1ac None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:51.113875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:51.114691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.114979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.115260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.138333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:51.148577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:51.149463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:51.151545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 50/100] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:51.156008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.303138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02babd5f-32be-4a0e-b366-99abf57c7146 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:51.347533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:51.348217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.348503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.348782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.349543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:51.349853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:51.351232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:51.363006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 51/101] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:51.369417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.511018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86665457-fa34-40a9-9f59-b1f019d312e7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:51.553769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:51.554660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.554941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.555216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.560097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:51.561646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec78b12-8254-4a6e-85c8-ed4366d4b45b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:51.563307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 51/102] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:51 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:51.569198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.671965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c20ca-548a-463b-a6d1-582af3a7e649 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.672289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c20ca-548a-463b-a6d1-582af3a7e649 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.672496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c20ca-548a-463b-a6d1-582af3a7e649 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.673835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 52/103] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:51.678851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.679143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.679441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.712495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:51.713687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:51.722730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b9a4-7830-40af-85cc-5f8f2459eea2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:51.789466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:51.790357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:51.790651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:51.790932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:51.792267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:51.793994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:51.796316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 52/104] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:51 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:51.802699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.841907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 53/105] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:51.876958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:51.976971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ab3f5-ef7d-4ab0-b926-a05829533d46 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.042787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.043776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.044064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.044381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/users/20fcf0cba5134cd9abba8606e062329a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.046453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, user_id=20fcf0cba5134cd9abba8606e062329a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:52.047952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5cf82-cf69-4d35-a4aa-a0dca3b76427 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:52.088674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 53/106] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:25:51 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/users/20fcf0cba5134cd9abba8606e062329a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:25:52.097853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa47fa-9934-4688-87a0-ecbe68ac89a5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.152302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.152620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94789a-365b-424e-b686-8d1fba31df59 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.152899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94789a-365b-424e-b686-8d1fba31df59 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.153113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.153209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94789a-365b-424e-b686-8d1fba31df59 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.153388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.153657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.154543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 54/107] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:52.160032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.160312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.160587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.169688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:52.179568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:52.180558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:52.181345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 54/108] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:52.187017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.192504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:52.193700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:52.337830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 55/109] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:52.373244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.379982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab5c29-7310-4505-8651-c1b7e9b88d62 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.449084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.449857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.450142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.450412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.451180 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:52.451576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:52.453028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:52.461850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 55/110] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:52.467825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.476580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c3b16-3d5c-4094-8a2a-6f77eb12e5f7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.510940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a40c65-b439-4504-94d5-491603568634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.511789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40c65-b439-4504-94d5-491603568634 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.512066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40c65-b439-4504-94d5-491603568634 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.512333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a40c65-b439-4504-94d5-491603568634 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.523142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a40c65-b439-4504-94d5-491603568634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-21a40c65-b439-4504-94d5-491603568634 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:52.530815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:52.531723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:52.532905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 56/111] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:25:52.533550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e3a-ed1e-43f6-9d01-9e3063364bad None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.533550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e3a-ed1e-43f6-9d01-9e3063364bad None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.533909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a11e3a-ed1e-43f6-9d01-9e3063364bad None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.535200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 57/112] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:52.540500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.540773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.541046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.559214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:52.560408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:52.581723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d467-f59b-4cbb-97c2-f9ed0e674789 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.622369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.623238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.623573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.623892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] PATH_INFO: `/v3/users/9763e27d702044b3b421751b6751e53a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.625134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:52.626123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.648107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] RBAC: Authorizing `identity:get_user(user_id=9763e27d702044b3b421751b6751e53a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:52.649672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:52.651441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 56/114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/users/9763e27d702044b3b421751b6751e53a => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:52.657019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.721930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f4593-99f3-4b12-b782-a9eeea49ddf8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.755020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.755899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.756028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.756248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.757051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:52.757354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:52.758853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:52.771524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 59/115] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:52.771524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.775309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4262225-e034-4302-9ef3-69490180e042 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.812950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.813974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.814435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.815052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.878386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4dc6c-72cd-40ff-8e09-14ff4bb9ce34 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:52.882183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:52.884121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:52.911605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:52.912514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.912870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.913225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.923787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-d3bcdfbf-d7e7-457b-9d6d-de5584738498 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:52.932239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:52.933066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:52.933833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 60/116] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:52.939595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66189e5-ca1c-4bd6-9527-713bbe7907a0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:52.940012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66189e5-ca1c-4bd6-9527-713bbe7907a0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:52.940219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66189e5-ca1c-4bd6-9527-713bbe7907a0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:52.941521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 61/117] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:52.943639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66189e5-ca1c-4bd6-9527-713bbe7907a0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:52.983153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 57/118] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:25:52.984228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.052298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66189e5-ca1c-4bd6-9527-713bbe7907a0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.081062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009f7c2-5110-4b75-8501-bd2f1ef0b1d1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.085467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.086396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.086691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.086947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.088327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.089785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657519b-4f34-41bf-81b7-a54bb24d189f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.091651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 62/119] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.092715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.092998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.093586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.109999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:53.111202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:53.120006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.120652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.120939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.121223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.121986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:53.122294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.123781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53db2-e1a3-48a1-a2cc-470a7e5261e6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.131779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 58/120] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:25:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.137642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47d55-2e0b-4428-9709-9406f8509672 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.137931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47d55-2e0b-4428-9709-9406f8509672 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.138209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47d55-2e0b-4428-9709-9406f8509672 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.139530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 59/121] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:53.143603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47d55-2e0b-4428-9709-9406f8509672 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.181514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 63/122] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:53.182484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.261822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47d55-2e0b-4428-9709-9406f8509672 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.281782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcb3fa-388a-4f2f-aabc-f9e1dc2f9dc7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.295028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.296009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.296292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.296605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.297743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.299224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.305919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 60/123] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.305919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.320742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.321839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.322102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.322368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.323558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.325015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9450573-7002-44d2-87eb-63fbd4f98284 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.326895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 64/124] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.327931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.328212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.328482 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.345086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:53.346255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:53.404600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd13b97-4221-4b01-892c-8f82b4fecbf1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.409351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 65/125] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:53.412261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.440647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.441544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.441812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.442084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.443266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.444762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.446388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 61/126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.447540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.510882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cfa8b-cdc8-4495-9010-07b04838f1df None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.541926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db89b5-dae5-49cd-80b1-2fc9090e0855 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.544406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.545238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.545594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.545851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.547037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.548555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.550364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 66/127] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.555357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.576137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.576865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.577133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.577405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.578250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=9763e27d702044b3b421751b6751e53a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:53.578555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.580021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.585186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 62/128] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/role_assignments?user.id=9763e27d702044b3b421751b6751e53a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.588309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.660189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fbc5d-95f6-4849-802d-70f2e0e31aa5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.696362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.697655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.698124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.698580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/users/f6c818d1963e4410bafbf00912c084aa/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.700840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, user_id=f6c818d1963e4410bafbf00912c084aa, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.701693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54400-be77-4d1a-b0c5-653e30de7931 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.702896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.721017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 67/129] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:25:53 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/users/f6c818d1963e4410bafbf00912c084aa/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:25:53.722240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.767137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.767352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.767663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.767875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.785349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:53.796930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:53.797913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:53.798690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 63/130] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:53.799845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.842795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97336c40-39b0-440d-b2a6-796353aa5fe0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.879408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.881083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.881553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.882010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.883534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.885299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.887353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 68/131] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:53.888371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.919454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb30ced-2c91-46b4-9bae-5ae90af72a2c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:53.955179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:53.956062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:53.956165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:53.956544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:53.957267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:53.958818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:53.990591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 64/132] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:25:53 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:53.991501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:53.999422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4533d1ef-c3d1-4099-a23c-57b85384f722 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:54.063423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:54.064460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.064929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.065387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.066325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:54.066860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:54.068470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:54.086020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 69/133] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:54.091940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:54.107953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d77fff-77dc-40a3-a15a-19228896fbd1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:54.184882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:54.186208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.187609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.188075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/users/20fcf0cba5134cd9abba8606e062329a/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.193187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, user_id=20fcf0cba5134cd9abba8606e062329a, role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:54.195722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:54.225566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 65/134] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:25:53 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/users/20fcf0cba5134cd9abba8606e062329a/roles/3f129043517b4e948ef87a9befee7394 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:25:54.262058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69da37b-6b71-41e7-b038-c15f5c3f8ea3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:54.315617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:54.316536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.316825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.317109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.318396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:54.319913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:54.321769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 70/135] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:54 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:54.327529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:54.437346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f24d60-a669-4ded-9d07-66c6406f0bcb None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:54.474750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:54.475983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.476515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.476974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] PATH_INFO: `/v3/projects/13e26cf7217240689c4fc2365db3894e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.478539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=13e26cf7217240689c4fc2365db3894e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:54.480259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d1d3-6ff6-4756-8083-44b181de7ac9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:54.482206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 66/136] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:54 2022] GET /identity/v3/projects/13e26cf7217240689c4fc2365db3894e => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:54.488424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:54.641272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23482e38-e949-4441-ae51-90cb2e01474d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:54.686718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:54.687725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.687952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.688227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] PATH_INFO: `/v3/projects/13e26cf7217240689c4fc2365db3894e/users/20fcf0cba5134cd9abba8606e062329a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.690233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=13e26cf7217240689c4fc2365db3894e, user_id=20fcf0cba5134cd9abba8606e062329a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:54.691724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125e1e1-695d-431a-8fd7-4e05d85c8b6c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:54.723290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 71/137] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:25:54 2022] PUT /identity/v3/projects/13e26cf7217240689c4fc2365db3894e/users/20fcf0cba5134cd9abba8606e062329a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:25:54.804193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66823-0bc3-49f1-94fe-c8a915bec75f None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.804836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66823-0bc3-49f1-94fe-c8a915bec75f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.805305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad66823-0bc3-49f1-94fe-c8a915bec75f None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.806956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 67/138] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:54.812901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:54.813191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:54.813475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:54.834924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:54.836201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:54.925733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 72/139] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:54.951692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad66823-0bc3-49f1-94fe-c8a915bec75f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:55.061457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad66823-0bc3-49f1-94fe-c8a915bec75f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:55.095807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:55.096978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:55.097469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:55.097940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:55.110697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:55.118863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:55.119766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:55.120513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:55.122832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 68/140] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:55.128822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:55.255453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f1a4-389e-492d-b0d0-82c550764ae6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:55.298782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:55.299486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:55.299775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:55.300054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:55.300810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:55.301121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:55.302498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:55.311348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 73/141] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:55.316795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:55.521582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225fd2a-3a21-4ed6-975b-a5ec4384eaae None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:55.580085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:55.581019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:55.581304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:55.581583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:55.582800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:55.584291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:55.586232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 69/142] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:55 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:55.591795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:55.703634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901f92d-f61b-4f16-aad8-af56c3d227ca None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:55.742898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:55.743616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:55.743905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:55.744184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:55.816983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:55.818376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:55.914558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 74/143] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:55.920334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:56.116992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34965f-fed1-4e17-80fd-500e0dc72988 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:56.158148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:56.159016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:56.159472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:56.159756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:56.160983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:56.162425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a77ee9-33c4-42e4-a716-001470d63f65 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:56.164376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 70/144] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:55 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:56.170461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:56.300128 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e353af-f309-463d-a2ef-f9635847f2cc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:56.342376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:56.343729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:56.344210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:56.344668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:56.345708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:56.346202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:56.347873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a6f5e-b779-4a2a-80f1-8577a14ac84d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:56.358867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 75/145] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:56 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:57.157458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24d08-6251-4135-af41-9a8721b9a5c5 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.157998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24d08-6251-4135-af41-9a8721b9a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.157998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e24d08-6251-4135-af41-9a8721b9a5c5 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.159645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 71/146] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:57.165725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151314-edda-4682-b5e2-ab7090330c8b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.166017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151314-edda-4682-b5e2-ab7090330c8b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.166283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87151314-edda-4682-b5e2-ab7090330c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.188395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-87151314-edda-4682-b5e2-ab7090330c8b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:57.189572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-87151314-edda-4682-b5e2-ab7090330c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:57.269265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 76/147] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:57.291547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e24d08-6251-4135-af41-9a8721b9a5c5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.333671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b92e-94db-470f-8f58-f02998d4eb27 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.334003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b92e-94db-470f-8f58-f02998d4eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.334282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4b92e-94db-470f-8f58-f02998d4eb27 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.335685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 77/148] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:25:57.341330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.341649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.341920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.360269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:57.361479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:57.454916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e24d08-6251-4135-af41-9a8721b9a5c5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:57.457624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 78/149] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:25:57.483388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.516671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:57.517490 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.517772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.518047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.533580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-ff40b145-0afc-4b9a-947d-13176998cbf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:57.541384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:57.542401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:57.543168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 72/150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:57.544176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5a5b-9a2b-4067-895d-0688e8dea454 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.544176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5a5b-9a2b-4067-895d-0688e8dea454 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.544451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f5a5b-9a2b-4067-895d-0688e8dea454 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.545712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 73/151] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:57.546779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56139-be74-4f33-97b0-97c4c8b75025 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.547075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56139-be74-4f33-97b0-97c4c8b75025 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.547355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c56139-be74-4f33-97b0-97c4c8b75025 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.553667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 74/152] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:57.553667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56139-be74-4f33-97b0-97c4c8b75025 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.588279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b1400-a2c2-448c-82fc-fb7b29669f39 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:57.620936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:57.621750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.622044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.622313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.623565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:57.625019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a478f-374b-47bf-b781-587e6ba94a47 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:57.626646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 79/153] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:25:57.631111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d65b2-3b81-4d7c-b681-0acc898ba121 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.631111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d65b2-3b81-4d7c-b681-0acc898ba121 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.631111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d65b2-3b81-4d7c-b681-0acc898ba121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.644234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-552d65b2-3b81-4d7c-b681-0acc898ba121 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:57.645408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-552d65b2-3b81-4d7c-b681-0acc898ba121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:57.665647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c56139-be74-4f33-97b0-97c4c8b75025 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:57.698194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:57.698953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.699244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.699546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.700291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:57.700595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:57.701984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:57.709644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 80/154] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:57.711112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.711567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.711984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.715084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 75/155] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:57.715938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.734566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:57.735956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:57.806184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 81/156] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:57.808259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.830729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070e94a-8c0c-416f-bce4-9135f7ee6e52 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:57.864323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:57.865000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.865274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.865544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.866247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:57.867726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:57.888358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 76/157] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:25:57 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:25:57.889162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:57.939887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e2648-742a-4bc6-99e3-c04f1e2027a9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:57.978028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:57.978855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:57.979115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:57.979408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] PATH_INFO: `/v3/users/9763e27d702044b3b421751b6751e53a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:57.980684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] RBAC: Authorizing `identity:get_user(user_id=9763e27d702044b3b421751b6751e53a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:57.982179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:57.984140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 82/158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/users/9763e27d702044b3b421751b6751e53a => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:57.984833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.013946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc163c-a8b2-49e1-873f-3ca4d5d1e8e3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.053092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.054197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.054486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.054765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.066977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-11b9aaeb-8790-4233-9cb7-c0182fb0689c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:58.074615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:58.075634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:58.076423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 77/159] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:58.077712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645121b-3353-452c-b57a-0ca72296b9b4 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.077809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645121b-3353-452c-b57a-0ca72296b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.078080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7645121b-3353-452c-b57a-0ca72296b9b4 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.079363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 78/160] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:25:58.081494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645121b-3353-452c-b57a-0ca72296b9b4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.089182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe8050e-3748-403c-8166-76463cfbb349 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.126318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.127127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.128181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.128181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.140518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:58.148790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:58.149663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:25:58.150587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:25:58.155211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 83/161] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:25:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:58.155211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.204964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7645121b-3353-452c-b57a-0ca72296b9b4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.239264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.240569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.241047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.241516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.242933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.244666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d42ba-2aa8-4bdc-ab65-e44a144ca354 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.246662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 79/162] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:58.248068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.248630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.249102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.257888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302087e-c2f3-46f3-96b3-8b43834fe0b7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.271848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:25:58.273359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:25:58.292116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.292790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.293064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.293343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.294069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:58.294371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.296251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.304233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 84/163] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:58.305058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.342991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 80/164] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:25:58.344473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.406589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e5bde7-ad92-4752-b54b-53252b0b2865 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.448276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.449408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.449818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.450094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.450856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:58.451159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.451324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c8997-4c3d-4af2-bb72-962a8db42057 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.453066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.463451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 85/165] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:58.464234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.493582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.494451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.494772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.495045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/users/9763e27d702044b3b421751b6751e53a/roles/be73f38f7c2d47b4b188f980ff546b9a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.497105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, user_id=9763e27d702044b3b421751b6751e53a, role_id=be73f38f7c2d47b4b188f980ff546b9a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.498767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.516756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 81/166] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:25:58 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/users/9763e27d702044b3b421751b6751e53a/roles/be73f38f7c2d47b4b188f980ff546b9a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:25:58.517665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.586309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cfc62-2156-491c-8646-324845f06b27 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.623337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3953b3-8ccb-42a0-b6d4-8d265e67b906 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.644270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.645207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.645493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.645770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] PATH_INFO: `/v3/users/f6c818d1963e4410bafbf00912c084aa` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.650444 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] RBAC: Authorizing `identity:get_user(user_id=f6c818d1963e4410bafbf00912c084aa)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.651982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.653937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 86/167] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/users/f6c818d1963e4410bafbf00912c084aa => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:58.654665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.660645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.661459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.661734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.662006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.673863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:25:58.681933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:25:58.684150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 82/168] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:25:58.686091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:58.791829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf6d4f-09af-4727-a4a0-a39e0c61dbf9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.826803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:58.827485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:58.827767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:58.828036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:58.896148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:58.897629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:58.923052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c6770-6f48-41a6-80af-287a9c4a971d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:58.994862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 83/169] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:58.995725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.004898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.005800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.006078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.006353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.008214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.009664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.011313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 87/170] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:59.012097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.091806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de6ff-d227-49b1-a3b2-0fdcd200a1f6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.125862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.126523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.126797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.127066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.127838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:59.128141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.129520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.138074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 84/171] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:25:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:59.138890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.181033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc5ac5-6828-4fef-8575-76473e4a9078 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.214037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.214918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.215194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.215497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.216707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.218603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.220368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 88/172] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:59.225908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.275513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61430465-843e-4a9e-819e-17689e6f0f74 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.337739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c65ac-f90f-41d6-938a-86a5672c52d2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.353024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.353615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.353893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.354163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.371145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.372061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.372341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.372618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] PATH_INFO: `/v3/users/20fcf0cba5134cd9abba8606e062329a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.373837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] RBAC: Authorizing `identity:get_user(user_id=20fcf0cba5134cd9abba8606e062329a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.375276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.381458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 89/173] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/users/20fcf0cba5134cd9abba8606e062329a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:59.382285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.479191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9987-ca62-42bf-9e15-7388eea6343b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.508704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.510187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.512554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.513208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.513483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.513751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.514646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=f6c818d1963e4410bafbf00912c084aa) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:25:59.514952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.516406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:25:59.534746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 90/174] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/role_assignments?user.id=f6c818d1963e4410bafbf00912c084aa&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:25:59.535645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.731252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc00b-e8ae-4c2c-a210-910e4e60780e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:25:59.803794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 85/175] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:25:59.811223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:25:59.812795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:25:59.813684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:25:59.814166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:25:59.814677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:25:59.956661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:25:59.958561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:00.023017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad948ecc-0a4b-493b-b69f-235ee21858cf None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:00.101226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:00.102137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:00.102412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:00.102690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:00.104008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:00.105502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:00.107309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 86/176] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:00.113330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:00.167580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 91/177] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:25:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:00.192176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:00.269054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0974a6d-f31f-4ff9-a653-fa71cc16cd5f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:00.302837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:00.303453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:00.303817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:00.304008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:00.304914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:00.305227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:00.306674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:00.312731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 87/178] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:00 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=3f129043517b4e948ef87a9befee7394 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:00.327290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1106af9a-6d66-4adf-896a-5c189c013116 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:00.372851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:00.374800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:00.375296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:00.375800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] PATH_INFO: `/v3/projects/13e26cf7217240689c4fc2365db3894e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:00.380312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] RBAC: Authorizing `identity:get_project(project_id=13e26cf7217240689c4fc2365db3894e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:00.382225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9a4ce-fa2a-4a40-87c9-b17b2ccebb6e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:00.384380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 92/179] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:00 2022] GET /identity/v3/projects/13e26cf7217240689c4fc2365db3894e => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:00.393265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:00.541229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfe289-664b-4f4d-b32a-17cda54042e6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:00.580052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:00.580725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:00.581005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:00.581283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:00.582135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=13e26cf7217240689c4fc2365db3894e, user.id=20fcf0cba5134cd9abba8606e062329a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:00.582446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:00.583995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52959da7-3929-4ffa-bc93-6e14483eb38b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:00.590496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 88/180] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:00 2022] GET /identity/v3/role_assignments?user.id=20fcf0cba5134cd9abba8606e062329a&scope.project.id=13e26cf7217240689c4fc2365db3894e&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:01.226918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd6ce-0adf-4aa6-8601-aceac7260fc3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.227636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd6ce-0adf-4aa6-8601-aceac7260fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.228137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bfd6ce-0adf-4aa6-8601-aceac7260fc3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.229749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 93/181] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:01.235095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272060-cb7c-449a-9ef6-a24a634d060d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.235438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272060-cb7c-449a-9ef6-a24a634d060d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.235712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50272060-cb7c-449a-9ef6-a24a634d060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.261251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-50272060-cb7c-449a-9ef6-a24a634d060d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:01.262447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-50272060-cb7c-449a-9ef6-a24a634d060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:01.336521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 89/182] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:01.359873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfd6ce-0adf-4aa6-8601-aceac7260fc3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.468787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bfd6ce-0adf-4aa6-8601-aceac7260fc3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:01.478862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353d0b-1999-40e0-b68f-a9570f0eb1d8 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.479459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353d0b-1999-40e0-b68f-a9570f0eb1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.480249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84353d0b-1999-40e0-b68f-a9570f0eb1d8 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.482368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 90/183] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:01.487029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa847d-0b61-4f55-be76-d30a2b7053c9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.487592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa847d-0b61-4f55-be76-d30a2b7053c9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.488054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa847d-0b61-4f55-be76-d30a2b7053c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.504875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c9aa847d-0b61-4f55-be76-d30a2b7053c9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:01.506407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c9aa847d-0b61-4f55-be76-d30a2b7053c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:01.506512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:01.507296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.507626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.507900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.521996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:01.531898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:01.532798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:01.533572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 94/184] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:01.539955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.600112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 91/185] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:01.608680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf253a-91ea-4d02-8e34-d653f8e947c8 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.608974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf253a-91ea-4d02-8e34-d653f8e947c8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.609254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf253a-91ea-4d02-8e34-d653f8e947c8 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.610727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 92/186] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:01.615217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75197a9-dc3a-4e2b-bff6-cde7e60b50e3 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.615545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75197a9-dc3a-4e2b-bff6-cde7e60b50e3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.615830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75197a9-dc3a-4e2b-bff6-cde7e60b50e3 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.617092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 93/187] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:01.618146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.618429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.618701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.635215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:01.636448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:01.651218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2eca1-03bc-4b04-a2a8-f295cd121926 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:01.683149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:01.683837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.684112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.684380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.685117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:01.685420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:01.686798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec4d23-3f1f-473d-b272-00154740980b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:01.694663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 95/188] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:01.695611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.695891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.696160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.697763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 94/189] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:01.704357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.712087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:01.713222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:01.773883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 96/190] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:01.775563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.798633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb050b-a8a6-43f7-8a57-61a2588690e0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:01.832792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:01.833582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.833838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.834181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.835270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:01.836757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:01.838366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 95/191] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:01.840231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.869519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f89e1-3a53-4612-92eb-f5c00219fe89 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:01.901225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:01.902108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.902387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.902659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.917306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:01.918748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:01.920474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 97/192] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:01.921215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:01.935512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057c6e-4edd-4d1d-bc19-129ae9620afd None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:01.968429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:01.969218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:01.969494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:01.969758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:01.979658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:01.987090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:01.987991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:01.988770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 96/193] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:01.989754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.020510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54f951-e0b9-4450-9a7b-2212a3f76ab3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.052826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.053561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.053836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.054106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.063857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:02.071828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:02.072791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:02.073562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 98/194] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:02.074361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.090149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2895e-bc60-4ff6-a87f-670bd524186c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.122202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.122865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.123150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.123473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.124211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.125651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.144740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 97/195] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:01 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:02.145534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.182126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de846d-43d4-4301-b28a-9461945f69dc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.218004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.218963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.219235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.219546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.262123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50680a5-3fe4-4dce-a18e-11c6b345cd18 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.291877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.293660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.296071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.296747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.297023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.297315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.298047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:02.298349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.299778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.313275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 98/196] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.313275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.397361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:02.402654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.408638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4bd607-f747-433c-a0dc-68a5dd526510 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.442445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.443355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.443815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.444220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.445110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:02.445545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.447058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.455865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 99/198] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.456915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.529098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0009c3-12b5-46b8-817d-d69955a8b4f7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.562506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1431510-ab6d-43cc-93f5-ae57156741ea None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.572929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.574393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.574675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.574953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] PATH_INFO: `/v3/users/9763e27d702044b3b421751b6751e53a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.576788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=9763e27d702044b3b421751b6751e53a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.578657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.581801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 100/199] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/users/9763e27d702044b3b421751b6751e53a => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.582573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.604798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.605679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.605963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.606239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.608021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.609802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.612346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 100/200] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.613268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.691410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26489bb-bf4e-4e15-8887-6a488e9ce6d7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.724841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.725715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.725988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.726255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.727479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.728982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.734081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175bcbd-80dc-45cd-81c7-8331636afc23 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.735459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 101/201] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.736290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:02.774316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.775401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.775690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.775968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.836820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fec99b-014e-4934-b82c-400d1394f339 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:02.851981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.853468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.877896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:02.878558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:02.878988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:02.879585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:02.880706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=570f4aaedb0142539af703363c7065fd) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:02.881022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:02.883194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:02.889492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 102/202] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/role_assignments?user.id=570f4aaedb0142539af703363c7065fd&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:02.890271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:03.008427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91695a68-5f41-46fd-a9f7-b1702f041c25 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:03.046371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:03.047038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:03.047395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:03.047675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:03.054215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 101/203] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:03.072054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:03.131006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:03.133162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:03.236583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f9494-b7f8-4314-a516-bc4b56fdf6f6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:03.248754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 103/204] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:03.249952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:03.278864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:03.280077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:03.280512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:03.280947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:03.285283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:03.286749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:03.294333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 102/205] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:03 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:03.295247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:03.431983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc7943-6c9d-4278-b0bc-5acd610d4387 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:03.466826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:03.468767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:03.469129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:03.469586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:03.471470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:03.472967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:03.474786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 104/206] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:03 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:03.480766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:03.483756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e42cf-5ea1-45c1-846c-8eb2263c8a39 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:03.518008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:03.519064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:03.519599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:03.520112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:03.521146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, scope.project.id=437d0218d6364e47956b4a8911e3619a, user.id=9763e27d702044b3b421751b6751e53a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:03.521653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:03.523315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7210255-5ff3-4f7b-96a5-707b0e9960d9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:03.529505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 103/207] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:03 2022] GET /identity/v3/role_assignments?user.id=9763e27d702044b3b421751b6751e53a&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:03.582930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e813f-550e-43c5-bb9d-4b01d9a3a742 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:03.620696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:03.621363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:03.621654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:03.621907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:03.622749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=570f4aaedb0142539af703363c7065fd) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:03.623056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:03.624599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88367e5-52df-4fc1-937a-a6322357988f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:03.631110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 105/208] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:03 2022] GET /identity/v3/role_assignments?user.id=570f4aaedb0142539af703363c7065fd&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=3f129043517b4e948ef87a9befee7394 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:04.636497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dc50-e7cc-4334-aa66-7e91a6f456a8 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.637019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dc50-e7cc-4334-aa66-7e91a6f456a8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.637094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9dc50-e7cc-4334-aa66-7e91a6f456a8 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:04.638575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 104/209] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:04.644157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.645001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.645461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:04.662010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:04.663487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:04.715453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8f6e-b650-464c-888a-9a3c53f5e7e1 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.715788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8f6e-b650-464c-888a-9a3c53f5e7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.716009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c8f6e-b650-464c-888a-9a3c53f5e7e1 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:04.717432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 105/210] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:04.722666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.722956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.723234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:04.729334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 106/211] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:04.740309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:04.741498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:04.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:04.813746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 106/212] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:04.838127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:04.870233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b30fe-f319-4bd0-aa67-7a7cb3474526 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:04.904470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:04.905225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.905465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.905738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:04.906910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:04.908392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:04.910029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 107/213] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:04.915941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:04.952020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5295ee4-10c7-423a-ad47-422b840067ec None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:04.989479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:04.990432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:04.990566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:04.990810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.002314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:05.010136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:05.011006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:05.011817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:05.016214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 107/214] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:05.017069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.029172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ceb62-2ec1-4a96-bab1-cb0f421f0f5b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.070656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.072114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.072752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.073291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.074316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:05.076571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:05.111343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 108/215] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:04 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:26:05.128081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf1d3-6825-4a7a-a7a7-d7dcb1793a63 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.165739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.166766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.167236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.167744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.168731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:05.169231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:05.170893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:05.181064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 108/216] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:05.191640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.295435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dfe9d-3093-417d-8a68-39b6bde091c3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.334684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.335842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.336247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.336740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] PATH_INFO: `/v3/users/1690a7a13706410bb85e3cd19422e071` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.351333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] RBAC: Authorizing `identity:get_user(user_id=1690a7a13706410bb85e3cd19422e071)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:05.353056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0050977-7a41-43f7-8cde-67ffbcad1452 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:05.355218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 109/217] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/users/1690a7a13706410bb85e3cd19422e071 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:05.361023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.463748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80909-15dd-453a-96a0-66310356f02a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.488768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ad14-714a-499f-981c-50170762f023 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.489076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ad14-714a-499f-981c-50170762f023 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.489314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ad14-714a-499f-981c-50170762f023 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.491201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 110/218] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:05.496466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.496992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.497452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.502870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.505682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.505682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.505682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.519821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:05.521016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:05.592332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:05.594113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:05.595480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 111/219] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:05.623559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.719604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46185147-53b8-4b53-83c8-093fb4f72124 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.742483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 109/220] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:05.747825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.758080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.758885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.759236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.759546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.776629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:05.784308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:05.785223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:05.786017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 112/221] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:05.800085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:05.931281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f5568-f976-49a1-ae0a-152c58c2c618 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.934316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db8807-1099-437c-ae4c-50ef644b9edc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:05.969545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:05.970269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:05.970487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:05.970755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:05.971965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:05.972272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:05.973655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:05.986826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 113/222] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:05.992342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.011554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.012414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.012691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.012963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.014213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.015693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e7e38-0e52-4220-adcc-3d04f9e6c6bb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.017567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 110/223] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:06.018561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf041-c3ac-43a4-afa0-dde7cafa1f29 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.018844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf041-c3ac-43a4-afa0-dde7cafa1f29 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.019122 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38acf041-c3ac-43a4-afa0-dde7cafa1f29 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.020364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 111/224] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:06.025178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acf041-c3ac-43a4-afa0-dde7cafa1f29 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.105194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f2660-0afd-48bf-8769-12af39cce78b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.123591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38acf041-c3ac-43a4-afa0-dde7cafa1f29 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.145272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.146154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.146436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.146707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.148039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.149528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a292a-3ef5-4d63-9f9a-eb8958e21a81 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.151162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 114/225] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:05 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:06.152323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.152607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.152882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.172152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.173066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.173501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.174296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.175436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=1690a7a13706410bb85e3cd19422e071) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:06.175954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.177497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.179608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:06.180876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:06.184641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 112/226] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/role_assignments?user.id=1690a7a13706410bb85e3cd19422e071&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:06.185443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.261132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 115/227] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:06.290840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.312888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff22d35-edbc-4f44-a760-7aedf51fcd87 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.347690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.348563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.348837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.349105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.350347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.351868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.353937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 113/228] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:06.360140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.398826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca621a-a686-4480-bcd4-6b4534ebf58a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.433591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.434412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.434696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.434972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.446985 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:06.457384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:06.458345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:06.459870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 116/229] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:06.461513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a9c53-d925-4d40-9e02-370d42e81980 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.465246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.495946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.496850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.497125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.497392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/570f4aaedb0142539af703363c7065fd/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.499517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, user_id=570f4aaedb0142539af703363c7065fd, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.501082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.531619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 114/230] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:06 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/570f4aaedb0142539af703363c7065fd/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:06.573823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c2d26-be23-41f4-922f-a6dd9aee97fc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.620383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.621138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.621461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.621737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.622512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:06.622817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.624402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.634460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 117/231] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:06.640208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.750080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827a048-6c70-47a8-a930-34ff9830a94b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.795064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.795917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.796204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.796480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.797751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.799340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.801343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 115/232] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:06.807568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:06.910627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c0c5c-2bda-45fd-b801-a0053a08fd27 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:06.943909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:06.944828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:06.945107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:06.945502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:06.946694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:06.948241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712af7b3-7acd-4d91-9250-1ca1b271b56a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:06.950246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 118/233] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:06 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:06.956286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:07.072523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395e76f-cc7f-480f-85a6-cbd83b0c9e89 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:07.120610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:07.121513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:07.121794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:07.122070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/570f4aaedb0142539af703363c7065fd/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:07.124640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, user_id=570f4aaedb0142539af703363c7065fd, role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:07.126109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d627c23-c953-41f2-882c-ad2dc0453e4a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:07.154292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 116/234] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:06 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/570f4aaedb0142539af703363c7065fd/roles/3f129043517b4e948ef87a9befee7394 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:07.798588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5491-ab4f-4808-983a-75fbf5bd1121 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:07.798969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5491-ab4f-4808-983a-75fbf5bd1121 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:07.799136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e5491-ab4f-4808-983a-75fbf5bd1121 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:07.800859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 119/235] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:07.805666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:07.806186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:07.806359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:07.829615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:07.830864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:07.914053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 117/236] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:07.962866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e5491-ab4f-4808-983a-75fbf5bd1121 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:08.072426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e5491-ab4f-4808-983a-75fbf5bd1121 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:08.107923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:08.108742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.109021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.109297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.110533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:08.112058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e46dd-b44d-4203-b58b-aa9bca24b26f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:08.113807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 120/237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:08.119606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:08.234789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5621b-5a99-42c3-80c2-4ec2f8ee63f3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:08.283508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:08.284178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.284506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.284774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.285479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:08.286917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:08.292127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f1cf-665c-43f7-9e03-b0bdd386833a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.292127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f1cf-665c-43f7-9e03-b0bdd386833a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.292127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882f1cf-665c-43f7-9e03-b0bdd386833a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.292127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 121/238] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:08.299620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d93ea-534b-472a-8979-027a83965f0c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.299620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d93ea-534b-472a-8979-027a83965f0c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.299620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d93ea-534b-472a-8979-027a83965f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.314357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 118/239] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:08 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:08.328098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-211d93ea-534b-472a-8979-027a83965f0c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:08.329833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-211d93ea-534b-472a-8979-027a83965f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:08.425736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 122/240] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:08.456826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:08.587299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840fff5-261f-4535-9641-80ce03df3ed9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:08.630681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:08.631512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.631797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.632072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.646445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:08.654247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:08.655158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:08.656067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 119/241] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:08.662738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d93ea-534b-472a-8979-027a83965f0c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:08.763549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d93ea-534b-472a-8979-027a83965f0c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:08.800026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:08.800800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.801083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.801358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.802132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:08.802439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:08.803904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:08.813779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 123/242] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:08.818945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:08.930072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa55dc-8fbf-4ae4-8692-2910cf738444 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:08.968433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:08.969330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:08.969604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:08.969875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] PATH_INFO: `/v3/users/69615ed9722c46f290ddaa5499c7cdc0` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:08.985778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] RBAC: Authorizing `identity:get_user(user_id=69615ed9722c46f290ddaa5499c7cdc0)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:08.987408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a213c82-1964-49f9-8b99-03ac7d5db398 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:08.989177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 120/243] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:08 2022] GET /identity/v3/users/69615ed9722c46f290ddaa5499c7cdc0 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:08.994778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:09.098855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff2528-c325-4e4b-9e12-a74ce0503579 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:09.132155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:09.132823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.133088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.133371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.203635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:09.205050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:09.277814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445d01-f871-4a94-94ec-44aaea5b261c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.278140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445d01-f871-4a94-94ec-44aaea5b261c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.282296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33445d01-f871-4a94-94ec-44aaea5b261c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.282296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 121/244] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:09.288055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.288336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.288612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.315550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:09.316763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:09.338529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 124/245] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:09.347795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:09.456930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 122/246] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:09.483585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c841e2-1864-45c9-8aa7-15616028d675 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:09.499888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:09.524973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:09.525848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.526122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.526393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.528426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:09.529995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:09.533326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 125/247] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:09 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:09.542499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:09.681272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696a23-54da-4daa-ac33-ef3ea277aa4b None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:09.691422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096a0c6-8d7e-4715-90d8-58a98d576e67 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:09.725071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:09.725665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.725943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.726219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.727054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=69615ed9722c46f290ddaa5499c7cdc0) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:09.727364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:09.728855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45b91a-d6d3-4c1d-af37-01a0abab1e8b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:09.737698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 126/248] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:09 2022] GET /identity/v3/role_assignments?user.id=69615ed9722c46f290ddaa5499c7cdc0&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:09.738968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60692b4-4ce4-49a8-9bd3-8995da8bd7d4 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.739253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60692b4-4ce4-49a8-9bd3-8995da8bd7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.745756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60692b4-4ce4-49a8-9bd3-8995da8bd7d4 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.749047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 127/249] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:09.755767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.756050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.756325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.758287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:09.759153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.759525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:09.759837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:09.786657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:09.792391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:09.793586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:09.794657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:09.795649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:09.796442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:09.801660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 123/250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:09.804068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:09.951049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064273a-d9f3-4f47-9efd-448733718760 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:09.997321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:09.997903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:09.998287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.000127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.000932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:10.001244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.003187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 128/251] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:10.004177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.018938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 124/252] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:10.024740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.051697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.194226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac8cdc-257c-44ab-966c-ffb70c861b50 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.209254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b4180-883b-4384-9f4f-cba32db3221c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.262037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.262848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.263128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.263416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.276601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.277491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.277766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.278037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] PATH_INFO: `/v3/users/1690a7a13706410bb85e3cd19422e071` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.281323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] RBAC: Authorizing `identity:get_user(user_id=1690a7a13706410bb85e3cd19422e071)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.282794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4b1d1-5db4-4c1f-83ab-174a82d5b502 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.284652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 129/253] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/users/1690a7a13706410bb85e3cd19422e071 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:10.290348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661832-9fe1-4f5c-93cc-431026e94b04 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.290632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661832-9fe1-4f5c-93cc-431026e94b04 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.290906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661832-9fe1-4f5c-93cc-431026e94b04 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.292889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:10.300914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:10.301783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:10.302570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:10.303227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 130/254] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:10.306945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.306945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.306945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.307428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 125/255] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:10.307906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.332726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:10.334281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:10.424347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 131/256] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:10.425319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.523046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb2432-a440-4001-abbc-47de67349ff7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.524581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481cda8-7e46-4b42-ba19-d1febab5a004 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.557440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.558105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.558382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.558651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.559409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:10.559720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.561120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.569237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 132/257] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:10.569915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.603721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.604999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.605463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.605916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.612077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.613739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.615678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 126/258] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:10.616602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.664084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb3674-b52e-4343-963c-a665f0873ab5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.696949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.697766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.698045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.698317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.717294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:10.730443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:10.731332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:10.732139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 133/259] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:10.732861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.787777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a61f17-3fc5-4a7c-a1e9-98b132ad80d5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.822447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.823340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.823656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.823926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.832667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.834129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.836005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 127/260] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:10.836689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.883803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86f40c-aa9e-4818-8dae-4d08a21e8879 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.954663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e8059-2a4a-41bf-b247-1d03dfac6a66 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:10.964306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.964988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.965272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.965549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/1690a7a13706410bb85e3cd19422e071/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.967706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, user_id=1690a7a13706410bb85e3cd19422e071, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:10.969501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:10.990786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 134/261] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:10 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/1690a7a13706410bb85e3cd19422e071/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:10.992845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:10.994951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:10.995914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:10.996518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:10.998754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:10.999815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:11.000316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:11.002289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:11.022545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 128/262] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:11.028524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:11.192855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f1a30-9098-40ad-966c-1e0c4066eb0a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:11.225033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbcb07-7609-46b9-9084-83ed68a0ea1e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:11.266387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:11.267042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.267328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.267625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.286356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:11.287312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.287622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.287948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] PATH_INFO: `/v3/users/570f4aaedb0142539af703363c7065fd` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.289201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] RBAC: Authorizing `identity:get_user(user_id=570f4aaedb0142539af703363c7065fd)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:11.293008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:11.294707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 129/263] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:11 2022] GET /identity/v3/users/570f4aaedb0142539af703363c7065fd => generated 283 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:11.301189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:11.390334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:11.392160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:11.500057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 135/264] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:11.505425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:11.522227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad094ce-20f0-4624-b5c7-8d8f7c46e80a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:11.586004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:11.586686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.587116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.587413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.727944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:11.729457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeeea3-1e41-49ca-80b6-3967f9d19429 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:11.756559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbdc84e-ed30-40b0-80bc-8772ea25fdee None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:11.816522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:11.817899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.818366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.818817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.820554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:11.822451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:11.824787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 136/265] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:11 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:11.831517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:11.930499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 130/266] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:11.932888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e40-7f06-432b-a288-06539e93176c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.934577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e40-7f06-432b-a288-06539e93176c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.935800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01455e40-7f06-432b-a288-06539e93176c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.937220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 131/267] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:11.938132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38118-104f-4c98-9385-2daf84446ed9 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:11.938405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38118-104f-4c98-9385-2daf84446ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:11.938673 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce38118-104f-4c98-9385-2daf84446ed9 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:11.939889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 132/268] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:11.940619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce38118-104f-4c98-9385-2daf84446ed9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:11.983491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c3f81-cc03-423a-8a0a-d30e0631e227 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.017413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.018385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.018863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.019347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.020401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=570f4aaedb0142539af703363c7065fd) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:12.020909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.022561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d74e95-9e68-4bc7-bdbd-f16a6b1ced0b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.035535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 137/269] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:11 2022] GET /identity/v3/role_assignments?user.id=570f4aaedb0142539af703363c7065fd&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:12.037387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.037870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.038291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce38118-104f-4c98-9385-2daf84446ed9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.038871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.067905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:12.069459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:12.073887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.074755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.075031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.075298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.076619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.083406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f907ed-43d1-4aee-8bba-b285f9764ad8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.083406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 133/270] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:11 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:12.083406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.083406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.083406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.103426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:12.103426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:12.176514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 134/271] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:12.177688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.189332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 138/272] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:12.217615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.303144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db47c0a-7758-4fc0-b143-8668725815f4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.343931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.344765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.345044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.345319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.346166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=570f4aaedb0142539af703363c7065fd) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:12.346469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.348129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.355533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 135/273] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/role_assignments?user.id=570f4aaedb0142539af703363c7065fd&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=3f129043517b4e948ef87a9befee7394 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:12.356386 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.445355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5320dfb-5213-45b6-b339-c449bafad4ac None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.487633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44177756-7dc4-4adc-97c0-5974b927bb72 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.500013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.501588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.502065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.502819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.516718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:12.526017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:12.526967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:12.527804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:12.531058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 139/274] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:12.537990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.549608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.550404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.550679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.555563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.555563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.555563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.556101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 136/275] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:12.561547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.701011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00231121-0cac-4fc9-8a67-fc201eee9144 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.715433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2594333-5166-420e-b925-3726cc08c340 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.742497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.743196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.744245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.744777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.745522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.747015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.774597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 137/276] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:12 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:12.777747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.778423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.778705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.779030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.784419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] RBAC: Adding query filter params (name=member) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:12.784419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.784419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc380a8-d90a-4c93-be8d-bba136e8501e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.796483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 140/277] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:12.801851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:12.843620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9d4f-536a-44dc-b30c-7fa0bf087a23 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.844230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9d4f-536a-44dc-b30c-7fa0bf087a23 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.844676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e9d4f-536a-44dc-b30c-7fa0bf087a23 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.846305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 141/278] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:12.853596 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.853893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.854140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.878643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:12.880530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:12.928148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78df117-5ba9-4fed-abbc-68756da223e6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:12.967238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:12.968685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:12.969081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:12.969437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] PATH_INFO: `/v3/users/ba183c158eb54e4682af08063197dc00` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:12.973103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 142/279] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:12.987412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] RBAC: Authorizing `identity:get_user(user_id=ba183c158eb54e4682af08063197dc00)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:12.988920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:12.990921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 138/280] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/users/ba183c158eb54e4682af08063197dc00 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:12.996609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.002020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.118969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121d12a-4752-4cd2-86f1-94701db694d9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.130407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323dfa9-2305-4a49-824d-57b7daa3679a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.165949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.166750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.167026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.167402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.171120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.171806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.172081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.172347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.173180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, user.id=ba183c158eb54e4682af08063197dc00, scope.system=all) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:13.173482 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:13.175009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:13.180718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 143/281] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 21:26:12 2022] GET /identity/v3/role_assignments?user.id=ba183c158eb54e4682af08063197dc00&scope.system=all&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:13.182005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:13.190367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:13.191332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:13.192226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 139/282] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:13.198085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.312010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b27df-ec4b-42fd-bd44-233033721c56 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.348533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.349228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.349515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.349783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.350556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:13.350860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:13.352355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:13.362056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 144/283] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:13.367891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.517872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ce8c00-46f0-488e-9350-480953528e0c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.562558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.563454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.563732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.564005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] PATH_INFO: `/v3/users/69615ed9722c46f290ddaa5499c7cdc0` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.568090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=69615ed9722c46f290ddaa5499c7cdc0)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:13.569538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:13.571507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 140/284] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:13 2022] GET /identity/v3/users/69615ed9722c46f290ddaa5499c7cdc0 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:13.577290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.702361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24099e-f56a-408b-b5d8-024906dadcab None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.744053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.744929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.745211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.745480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.746674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:13.748204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8706a-5ec5-42b2-a9de-84951ff6825c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:13.749913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 145/285] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:13 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:13.755965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:13.897555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43aec29-56fc-48f4-a059-a2b177d9f9c6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:13.938950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:13.940215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:13.940682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:13.941137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/69615ed9722c46f290ddaa5499c7cdc0/roles/be73f38f7c2d47b4b188f980ff546b9a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:13.948707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, user_id=69615ed9722c46f290ddaa5499c7cdc0, role_id=be73f38f7c2d47b4b188f980ff546b9a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:13.950444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537ded5-ffe9-4652-93d5-5286fed0e592 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:13.976371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 141/286] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:13 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/users/69615ed9722c46f290ddaa5499c7cdc0/roles/be73f38f7c2d47b4b188f980ff546b9a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:14.010354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47041-dca3-461c-b1cf-289dbad511cf None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.010668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47041-dca3-461c-b1cf-289dbad511cf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.010912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea47041-dca3-461c-b1cf-289dbad511cf None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.012805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 146/287] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:14.018772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.019352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.019857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.041839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:14.043514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:14.129759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 142/288] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:14.152807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47041-dca3-461c-b1cf-289dbad511cf None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:14.277783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea47041-dca3-461c-b1cf-289dbad511cf None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:14.317600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:14.318403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.318684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.318958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.331246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:14.338967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:14.339872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:14.340664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:14.341949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 147/289] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:14.346346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:14.489182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c2e6-0d31-4224-a471-114c3ebb70bf None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:14.535181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:14.535900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.536174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.536442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.537202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:14.537499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:14.538933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:14.548521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 143/290] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:14.556696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:14.680814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54be38-54c7-47bd-b2c6-a5c6ebdd5db6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:14.721910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:14.722788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.723065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.723335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] PATH_INFO: `/v3/users/1690a7a13706410bb85e3cd19422e071` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.724558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] RBAC: Authorizing `identity:get_user(user_id=1690a7a13706410bb85e3cd19422e071)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:14.726008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:14.727659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 148/291] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:14 2022] GET /identity/v3/users/1690a7a13706410bb85e3cd19422e071 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:14.733194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:14.855114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c39f554-7415-4491-827b-3c51e6e9e0c9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:14.891725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:14.892378 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:14.892656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:14.892921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:14.985605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:14.987071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:15.103056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 144/292] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:15.109055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:15.215258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33d615-b75f-468f-8df1-bdeb3e29fdf4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:15.248410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:15.249348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:15.249622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:15.249944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:15.251127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:15.252602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dcc93-0ef9-4fe7-a674-464a5954e297 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:15.254293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 149/293] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:15 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:15.260262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:15.373726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ae7b-4b2d-4ced-9dba-83dfd9e34d70 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:15.428676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:15.429347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:15.429624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:15.429895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:15.430756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=1690a7a13706410bb85e3cd19422e071) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:15.431065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:15.432595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365f5336-abdc-4f6e-acec-81ddc79669b0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:15.439017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 145/294] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:15 2022] GET /identity/v3/role_assignments?user.id=1690a7a13706410bb85e3cd19422e071&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:15.763776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426046a-fe5a-4eaa-b3c6-21d8c1c2bc5e None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:15.764426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426046a-fe5a-4eaa-b3c6-21d8c1c2bc5e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:15.764426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426046a-fe5a-4eaa-b3c6-21d8c1c2bc5e None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:15.765600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 150/295] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:15.771106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc054-1ce9-435b-b3e9-8ba264b3ae27 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:15.771404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc054-1ce9-435b-b3e9-8ba264b3ae27 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:15.771685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cc054-1ce9-435b-b3e9-8ba264b3ae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:15.789278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-111cc054-1ce9-435b-b3e9-8ba264b3ae27 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:15.790441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-111cc054-1ce9-435b-b3e9-8ba264b3ae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:15.873731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 146/296] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:15.899959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426046a-fe5a-4eaa-b3c6-21d8c1c2bc5e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.005906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426046a-fe5a-4eaa-b3c6-21d8c1c2bc5e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.038369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.039091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.039369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.039665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.044141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd626e-b3b6-4fb8-a4be-3819c1effddd None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.044725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd626e-b3b6-4fb8-a4be-3819c1effddd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.045216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd626e-b3b6-4fb8-a4be-3819c1effddd None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.047225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 147/297] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:16.051021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:16.052434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb5d7-e65f-4de6-a07c-14e6f9e9c024 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.052715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb5d7-e65f-4de6-a07c-14e6f9e9c024 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.053251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb5d7-e65f-4de6-a07c-14e6f9e9c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:16.057689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:16.058587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:16.059407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 151/298] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:16.064769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.074059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-02fdb5d7-e65f-4de6-a07c-14e6f9e9c024 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:16.075603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-02fdb5d7-e65f-4de6-a07c-14e6f9e9c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:16.142145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 148/299] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:16.143271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8feb5f-7197-447d-a67a-8a09f181d3cb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.143622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8feb5f-7197-447d-a67a-8a09f181d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.143895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8feb5f-7197-447d-a67a-8a09f181d3cb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.145289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 149/300] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:16.150323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.150850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.151311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.167914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:16.169532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:16.171615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11d02b-f654-420a-ba41-bb08fe578529 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.205548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.206224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.206505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.206778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.207554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:16.207861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.209248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.217753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 152/301] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:16.218638 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.243528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 150/302] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:16.244668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.328048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99ee38-efb9-4352-97ab-b958ea3f9306 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.349922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e86f67-b7d7-4939-8c8e-5881a5160b52 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.361707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.362539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.362821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.363100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.372994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:16.380620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:16.381508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:16.382321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 153/303] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:16.382965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.386450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.387324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.387635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.387911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] PATH_INFO: `/v3/users/0056831f624d4b8ca12974b70607daef` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.402346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] RBAC: Authorizing `identity:get_user(user_id=0056831f624d4b8ca12974b70607daef)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.403881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.410736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 151/304] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/users/0056831f624d4b8ca12974b70607daef => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:16.410736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.498783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dad0a-8095-43f7-9752-f41eecef0368 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.510783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a723dd0-5e4f-426d-9755-eec051cb1cbb None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.531027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.531845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.532096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.532371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.533535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.534987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.537778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 154/305] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:16.537778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.552255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.552926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.553200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.553497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.554218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:16.554518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.555922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.563970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 152/306] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:16.564728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.641393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d611a2-93e9-46cc-8f73-18774932c064 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.655843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344afeaa-09c4-4a69-87e2-e9f14b601ce8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.674031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.674689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.674970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.675267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.676124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, user.id=0056831f624d4b8ca12974b70607daef, scope.system=all) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:16.676433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.677886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.682713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 155/307] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/role_assignments?user.id=0056831f624d4b8ca12974b70607daef&scope.system=all&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:16.683503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.687778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.688461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.688738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.689011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] PATH_INFO: `/v3/groups` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.689716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.691181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc1773-f3da-461e-8545-b4f2b2f6a613 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.715431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 153/308] 10.222.0.23 () {60 vars in 1134 bytes} [Wed May 4 21:26:16 2022] POST /identity/v3/groups => generated 229 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:16.717296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa27fb-5fe1-4906-addd-ac1aeb1efe45 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.717587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa27fb-5fe1-4906-addd-ac1aeb1efe45 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.717862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa27fb-5fe1-4906-addd-ac1aeb1efe45 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.719722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 154/309] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:16.725733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.726077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.726300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.745545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:16.746922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:16.829801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135aa41-01f4-4ed9-a580-771f1ee884e5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.831925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 155/310] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:16.848954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.870947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.872299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.872901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.873435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] PATH_INFO: `/v3/users/ba183c158eb54e4682af08063197dc00` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.875053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] RBAC: Authorizing `identity:get_user(user_id=ba183c158eb54e4682af08063197dc00)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:16.876856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:16.878908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 156/311] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/users/ba183c158eb54e4682af08063197dc00 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:16.885314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:16.955346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b29a6-5ab7-456b-815c-cf36022c5f03 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:16.992810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:16.993308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:16.994043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:16.994043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:16.997278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba20ae9-695a-4624-9eb6-b1cf7af40d45 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.005551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:17.013183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:17.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:17.015251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 156/312] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:17.020372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:17.043626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.044495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.044890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.045223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] PATH_INFO: `/v3/system/users/ba183c158eb54e4682af08063197dc00/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.046710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ba183c158eb54e4682af08063197dc00, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.048173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.059191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 157/313] 10.222.0.23 () {58 vars in 1334 bytes} [Wed May 4 21:26:16 2022] PUT /identity/v3/system/users/ba183c158eb54e4682af08063197dc00/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:17.129021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecfdf8-e430-4ea4-aac6-c2a1bc65976f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.164505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.165193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.165468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.165733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.166499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:17.166915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.168373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.177892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 157/314] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:17.184982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:17.299702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446897ef-4ec7-4ae3-85f0-a324888a1117 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.331735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.332610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.332881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.333149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] PATH_INFO: `/v3/users/69615ed9722c46f290ddaa5499c7cdc0` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.334331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] RBAC: Authorizing `identity:get_user(user_id=69615ed9722c46f290ddaa5499c7cdc0)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.335827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.337735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 158/315] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:17 2022] GET /identity/v3/users/69615ed9722c46f290ddaa5499c7cdc0 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:17.344313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:17.442916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc3f1c-0bae-457e-9c6f-22dc20537494 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.475355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.476080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.476360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.476631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.542755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.544156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.641586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 158/316] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:26:17.646878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:17.748626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec50afa-605e-4d95-a073-594db8256418 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.780818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.781684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.781960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.782230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.783423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.785000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5ea8-3bb4-4efb-abd3-1eebde466deb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.786917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 159/317] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:17 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:17.792501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:17.904756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5b0b6-2f9d-476a-9873-3bc2c624ab0a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:17.938805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:17.939485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:17.939769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:17.940035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:17.940876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9, user.id=69615ed9722c46f290ddaa5499c7cdc0) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:17.941183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:17.942621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b505-39db-4717-bbaa-fb5afa64e4c6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:17.948660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 159/318] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:17 2022] GET /identity/v3/role_assignments?user.id=69615ed9722c46f290ddaa5499c7cdc0&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:18.950949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0617a0-3c2e-48da-93b2-3dcb33372432 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:18.951511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0617a0-3c2e-48da-93b2-3dcb33372432 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:18.951511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0617a0-3c2e-48da-93b2-3dcb33372432 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:18.953021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 160/319] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:18.958098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057c08-15a8-4bbe-b3f2-80e0c4ad4576 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:18.958501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057c08-15a8-4bbe-b3f2-80e0c4ad4576 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:18.958671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057c08-15a8-4bbe-b3f2-80e0c4ad4576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:18.975755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a7057c08-15a8-4bbe-b3f2-80e0c4ad4576 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:18.976912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a7057c08-15a8-4bbe-b3f2-80e0c4ad4576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:19.043419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 160/320] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:19.065206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0617a0-3c2e-48da-93b2-3dcb33372432 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.080879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a5cd-f00d-4080-825c-572ab0e5d327 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.081158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a5cd-f00d-4080-825c-572ab0e5d327 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.081441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a5cd-f00d-4080-825c-572ab0e5d327 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.082950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 161/321] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:19.087619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.087899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.088178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.104823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:19.105980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:19.169057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0617a0-3c2e-48da-93b2-3dcb33372432 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.172525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 162/322] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:19.195405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.204914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.205655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.205934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.206203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.216988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:19.225992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:19.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:19.227689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 161/323] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:19.234201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.310745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932f1f9-5905-40fe-872b-2bec35050de8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.337301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ae3f-6472-4866-8a53-fb9342b471ab None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.349041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.349847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.350124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.350395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.351682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.353136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d4881-1bd2-4cd7-a3aa-0406ad1960c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.359226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 163/324] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:19.359226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa6-28e8-44d6-90cf-c779bb59047c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.359226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa6-28e8-44d6-90cf-c779bb59047c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.359226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2fa6-28e8-44d6-90cf-c779bb59047c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.359226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 164/325] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:19.360501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2fa6-28e8-44d6-90cf-c779bb59047c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.369800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.370469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.370750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.371025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.371805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:19.372118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.373545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb128f-c3be-4ca3-8a80-ec09c0a2854e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.381303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 162/326] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:19.382449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.382738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.383016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.398681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:19.399895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:19.459170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2fa6-28e8-44d6-90cf-c779bb59047c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.478174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 163/327] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:19.479114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.492912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.493927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.494341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.494592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] PATH_INFO: `/v3/groups` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.495295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.496749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.511587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 165/328] 10.222.0.23 () {60 vars in 1134 bytes} [Wed May 4 21:26:19 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:19.512628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.590310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4a882-f8f1-489e-a901-00be2ba7aead None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.619765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe0c0-597b-4cc9-9e82-e61f6de23392 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.625692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.626579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.626870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.627144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] PATH_INFO: `/v3/users/0056831f624d4b8ca12974b70607daef` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.628380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] RBAC: Authorizing `identity:get_user(user_id=0056831f624d4b8ca12974b70607daef)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.629849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.631705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 164/329] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/users/0056831f624d4b8ca12974b70607daef => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:19.637356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.655320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.656161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.656416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.656692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.668323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:19.676388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:19.677406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:19.678198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 166/330] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:19.683435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.752906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d2b91-222e-4055-9867-de0cc4f1f154 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.785734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3487c-4b5d-4b68-974e-2e67c42aed59 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.787695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.788782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.789225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.789660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] PATH_INFO: `/v3/system/users/0056831f624d4b8ca12974b70607daef/roles/be73f38f7c2d47b4b188f980ff546b9a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.794853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0056831f624d4b8ca12974b70607daef, role_id=be73f38f7c2d47b4b188f980ff546b9a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.794853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.805822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 165/331] 10.222.0.23 () {58 vars in 1334 bytes} [Wed May 4 21:26:19 2022] PUT /identity/v3/system/users/0056831f624d4b8ca12974b70607daef/roles/be73f38f7c2d47b4b188f980ff546b9a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:26:19.822293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.822986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.823263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.823561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.824749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:19.824749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.826161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.836847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 167/332] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:19.843604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:19.950117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd27a3-d0d2-458d-8866-d95dd7a7b7bc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:19.987408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:19.988387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:19.988728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:19.989060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] PATH_INFO: `/v3/users/ba183c158eb54e4682af08063197dc00` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:19.990409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] RBAC: Authorizing `identity:get_user(user_id=ba183c158eb54e4682af08063197dc00)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:19.992005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa23822-0c70-4f65-85cc-16fe36633581 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:19.995196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 166/333] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/users/ba183c158eb54e4682af08063197dc00 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:20.000301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:20.104231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d25399-1a12-4b37-a3eb-fc0f069b6f50 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:20.140183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:20.140937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:20.141277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:20.141601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:20.142515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] RBAC: Adding query filter params (role.id=1461cca390e245e2ad8f81a72e0dc6d3, user.id=ba183c158eb54e4682af08063197dc00, scope.system=all) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:20.142885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:20.144425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa45f22-8a79-47e3-bfb3-869cfe0027cd None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:20.159171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 168/334] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 21:26:19 2022] GET /identity/v3/role_assignments?user.id=ba183c158eb54e4682af08063197dc00&scope.system=all&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:21.975212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87100-6319-42fd-b4bf-d5974f06bad6 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:21.976298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87100-6319-42fd-b4bf-d5974f06bad6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:21.976780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b87100-6319-42fd-b4bf-d5974f06bad6 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:21.978631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 167/335] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:21.983677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a751-16e0-4073-89cb-94e745924abf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:21.984108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a751-16e0-4073-89cb-94e745924abf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:21.984282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e085a751-16e0-4073-89cb-94e745924abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.008535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e085a751-16e0-4073-89cb-94e745924abf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:22.009721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e085a751-16e0-4073-89cb-94e745924abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:22.090012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 169/336] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:22.127143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b87100-6319-42fd-b4bf-d5974f06bad6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:22.259439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b87100-6319-42fd-b4bf-d5974f06bad6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:22.306373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:22.307173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.307465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.307731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.318243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:22.330003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:22.330975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:22.331853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 168/337] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:22.338754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085a751-16e0-4073-89cb-94e745924abf None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:22.461216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e085a751-16e0-4073-89cb-94e745924abf None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:22.502542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:22.503216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.503516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.503784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.504537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:22.504833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:22.506234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2351-6c5e-435b-9bdc-fe539c5976e8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:22.519046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 170/338] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:22.524466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:22.556805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c1073-a71c-4690-97f9-28b261847c53 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.557153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c1073-a71c-4690-97f9-28b261847c53 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.557343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c1073-a71c-4690-97f9-28b261847c53 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.558836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 171/339] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:22.567174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.567474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.567741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.596168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:22.597391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:22.640135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d325c-f010-4438-adca-dee92481dc74 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:22.679505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:22.680154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.680429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.680700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.722299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 172/340] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:22.764739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:22.777359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:22.778904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:22.919437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d627463-52f4-4f05-8ee5-e6f325fcaccf None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:22.932434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 169/341] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:22.937984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:22.958497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:22.959697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:22.960196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:22.960676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:22.982846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:22.991280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:22.996664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:22.997471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:23.000399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 173/342] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:23.005805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.039487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5773-1a73-4db2-a8b8-f134d0c632cb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.077365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.078279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.078542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.078827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.080029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.081468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a255a-80b8-4b2c-b090-8f32c54b1c37 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.091493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 170/343] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:22 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:23.093393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff80a9-886f-43d9-96e6-64852fd41e31 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.093677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff80a9-886f-43d9-96e6-64852fd41e31 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.093947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff80a9-886f-43d9-96e6-64852fd41e31 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.095625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 171/344] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:23.096335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff80a9-886f-43d9-96e6-64852fd41e31 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.127011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a767a-564c-48bc-aa50-d8d90fd2a820 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.169525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.170561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.171052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.171581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.172557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:23.173060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.174643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54ac71-fe35-490d-bc29-1171af8b1dc5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.183964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 174/345] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:23.185783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.186262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.186751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.203411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:23.204910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:23.228013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff80a9-886f-43d9-96e6-64852fd41e31 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.277358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.278208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.278488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.278781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.284111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 175/346] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:23.285197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.291712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.293113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.294901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 172/347] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:23.300578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.383893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f589f2-0246-4dc1-92c3-9aca618b5ab2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.420168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.421196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.421681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.422167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.457310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ffc51-6707-408f-b7ea-516c756223c4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.491794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.493644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66418e-0265-4afb-adfb-1116775ee099 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.494609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.495278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.495587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.495860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.496705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=437d0218d6364e47956b4a8911e3619a) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:23.497016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.498622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.505673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 173/348] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:23.506546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.598770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 176/349] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:23.600571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae2c5-ecf9-4f9e-84bd-578320493032 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.601071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae2c5-ecf9-4f9e-84bd-578320493032 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.601535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae2c5-ecf9-4f9e-84bd-578320493032 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.603283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 177/350] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:23.608625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.609094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.609535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.628735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:23.630253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:23.684256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45326a67-abcc-42c5-99e6-9409e928e683 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.705684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 178/351] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:23.706853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.728191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.729162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.730006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.730006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.744908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:23.761202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:23.762426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 04 21:26:23.763338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:23.763994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 174/352] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:23.764509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.851169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35805c-b115-4688-80f1-db56739ac5b9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.874107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151eeda-bf27-44b8-9c79-6ce5f6c2bd0b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:23.907064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.907996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.908356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.908694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.918989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:23.926853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:23.927781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:23.928571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 175/353] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:23.929221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:23.931086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:23.932176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:23.932644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:23.933078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:23.934452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:23.936232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:23.938395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 179/354] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:23.939336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.026764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc608c0-2839-4496-a205-84810d6415a5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.060367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.061089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.061464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.061821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.062919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:24.063286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.064980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.075496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 176/355] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.077044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.169408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b8c3c-1359-48c4-87e3-a30f635dd14b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.186978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e94fd2-2fc0-49f2-b3fb-9f7193cd2eeb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.213743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.214840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.215119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.215419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.216190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:24.216559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.218246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.226631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 180/356] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.227475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.234624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.235933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.236932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.237407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.238790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.240455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.242294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 177/357] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.243325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.362704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfa0535-3684-4c05-9f1a-df0e799c7c86 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.369015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e713744-5eae-48fa-bdc3-aa02b692c8f4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.405927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.406896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.407502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.407618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.407842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.408117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.408477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.409025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] PATH_INFO: `/v3/users/0056831f624d4b8ca12974b70607daef` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.410405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] RBAC: Authorizing `identity:get_user(user_id=0056831f624d4b8ca12974b70607daef)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.412238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.415213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 181/358] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/users/0056831f624d4b8ca12974b70607daef => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.416279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.479123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.480773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6ba2d-8241-4e70-868d-288e8eb756f0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.528678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d337a-27e6-4a6a-83a3-917b7a61396b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.562578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.563641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.564109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.564581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.565600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=437d0218d6364e47956b4a8911e3619a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:24.566095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.567757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee146d85-c4e2-40ea-9e8a-2390d7728cf5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.573804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 182/359] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=3f129043517b4e948ef87a9befee7394 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.575289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500786-6c48-477d-b28a-83be5cc552a1 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.575834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500786-6c48-477d-b28a-83be5cc552a1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.576292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40500786-6c48-477d-b28a-83be5cc552a1 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.577847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 183/360] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:24.578754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500786-6c48-477d-b28a-83be5cc552a1 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.583763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 178/361] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:24.585116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.585398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.585673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.605232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:24.606460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:24.684048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 179/362] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:24.685016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.737250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40500786-6c48-477d-b28a-83be5cc552a1 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.794220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd293c8-6c41-4642-b058-38a502de65d9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:24.824154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.824838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.825116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.825403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.826336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] RBAC: Adding query filter params (role.id=be73f38f7c2d47b4b188f980ff546b9a, user.id=0056831f624d4b8ca12974b70607daef, scope.system=all) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:24.826647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.828156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.830324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:24.831276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:24.831575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:24.831848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:24.833089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:24.834556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:24.836686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 180/363] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.837537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:24.857668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 184/364] 10.222.0.23 () {56 vars in 1308 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/role_assignments?user.id=0056831f624d4b8ca12974b70607daef&scope.system=all&role.id=be73f38f7c2d47b4b188f980ff546b9a => generated 510 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:24.858109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.004284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffc522-dda5-41a1-bd82-b5fd83852798 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.033086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bf7c6-5bce-48e4-9b96-5e8f1cee13ee None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.048517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.049411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.049692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.049965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.051284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.052838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b2654-b32e-46af-8b55-662b696072e5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.055138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 185/365] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:25.061667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d9d6-4854-432c-8754-476e91643e4e None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.062062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d9d6-4854-432c-8754-476e91643e4e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.062523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73d9d6-4854-432c-8754-476e91643e4e None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.064656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 186/366] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:25.068885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d9d6-4854-432c-8754-476e91643e4e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.119886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.120737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.121020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.121285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.152432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e7ca110e-c76a-4bad-9bc1-b0c814b669e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:25.167404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:25.168351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 181/367] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:25.169142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.169891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.169891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.193733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:25.194041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73d9d6-4854-432c-8754-476e91643e4e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.194935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:25.234514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.235199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.235506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.235778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.236620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:25.236951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.238367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.250029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 187/368] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:25.256054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.291565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 182/369] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:25.317056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.361378 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6b4bc-e01d-4967-8044-b9046cb8146b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.397275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.398841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.398841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.398841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.399094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:25.399371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.400790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.421373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 188/370] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:25.428205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.456048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887dba02-a3c6-4229-866f-ae3c02d42e36 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.529670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.530862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.531340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.531951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.549428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:25.561626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:25.562563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:25.563371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:25.565452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 183/371] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:25.571333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.577394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb60a2-d188-4f01-9c55-03fe81dc57c7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.610793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.611480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.611767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.612038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.680131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.681603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.690370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c12037-5355-46dc-95d8-ffba2adda396 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.725572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.726244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.726525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.726795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.727573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:25.727882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.729268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.742495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 184/372] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:25.743802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.780555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 189/373] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:25.786068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:25.872981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873ddae-3161-4844-aebb-7e64461e6e7f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.899519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8208bd-3dac-4bf6-8ed3-82fa86dc2290 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:25.922242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.922904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.923183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.923663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.960872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:25.961744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:25.962022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:25.962292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:25.964165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:25.965644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:25.968269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 190/374] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:25.984774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:26.021145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.022678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.125952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5157721-fe94-49bc-8986-a189b836758e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:26.128669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 185/375] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:26.129942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:26.165423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:26.166350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.166628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.166898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.168724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.170220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.172168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 191/376] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:25 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:26.205127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:26.259174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bca3d9-6a1e-4fdc-94fa-254b7ec798cb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:26.296110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:26.296980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.297260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.297536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] PATH_INFO: `/v3/projects/69a58d85914b42b5b2db98febd6721c4` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.298736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] RBAC: Authorizing `identity:get_project(project_id=69a58d85914b42b5b2db98febd6721c4)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.300232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.306499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 186/377] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:26 2022] GET /identity/v3/projects/69a58d85914b42b5b2db98febd6721c4 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:26.307771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:26.317496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302626-a283-459a-ac47-4911ff174e27 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:26.356080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:26.356810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.357139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.357412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.358252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:26.358559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.360028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.365998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 192/378] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:26 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=3f129043517b4e948ef87a9befee7394 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:26.422739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102548c9-7ce7-4c85-929e-2cfd466b771a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:26.458770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:26.459725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.460287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] PATH_INFO: `/v3/groups/ab5737040c9845d286e54e8c79f6089e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.466238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] RBAC: Authorizing `identity:get_group(group_id=ab5737040c9845d286e54e8c79f6089e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.467770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee953-66eb-477a-affa-99c78e28b2b4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.472158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 187/379] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:26 2022] GET /identity/v3/groups/ab5737040c9845d286e54e8c79f6089e => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:26.476268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:26.639613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f63e-58e5-42fb-a924-2adbc700fe0b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:26.678524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:26.679102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.679517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.679697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.680509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] RBAC: Adding query filter params (group.id=ab5737040c9845d286e54e8c79f6089e, role.id=1af302468b924833a9aea028857eac8d, scope.project.id=69a58d85914b42b5b2db98febd6721c4) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:26.680814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:26.682255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c196d84-c496-409e-b806-fcefbae445f0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:26.688566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 193/380] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:26 2022] GET /identity/v3/role_assignments?group.id=ab5737040c9845d286e54e8c79f6089e&scope.project.id=69a58d85914b42b5b2db98febd6721c4&role.id=1af302468b924833a9aea028857eac8d => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:26.830753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2825a-3847-46bb-94ae-d7c7447016a9 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.831208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2825a-3847-46bb-94ae-d7c7447016a9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.831607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e2825a-3847-46bb-94ae-d7c7447016a9 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.833345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 188/381] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:26.839102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:26.839403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:26.839673 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:26.858366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:26.859589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:26.929628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 194/382] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:26.951824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2825a-3847-46bb-94ae-d7c7447016a9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.068555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e2825a-3847-46bb-94ae-d7c7447016a9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.108019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.108817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.109093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.109358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.124749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:27.132578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:27.135014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:27.136946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 189/383] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:27.143551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.273509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7792e-1564-4590-858f-9935796d1d5f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.325967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.326643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.326923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.327195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.327978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:27.328278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:27.329653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:27.341812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 195/384] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:27.347907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.459815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96730-08a9-4896-9d71-2f8606adc7e6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.498490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e03d6-e029-494c-a624-77dee889441b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.499359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e03d6-e029-494c-a624-77dee889441b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.499662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e03d6-e029-494c-a624-77dee889441b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.499937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e03d6-e029-494c-a624-77dee889441b None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.501130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e03d6-e029-494c-a624-77dee889441b None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:27.502626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e03d6-e029-494c-a624-77dee889441b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:27.504599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 190/385] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:27 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:27.509719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.595856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1e02-2604-491b-a1d5-143d245aea60 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.596192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1e02-2604-491b-a1d5-143d245aea60 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.596405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c1e02-2604-491b-a1d5-143d245aea60 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.598060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 191/386] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:27.613106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.613389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.613670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.652422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:27.653684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:27.655714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f72dab-e688-4a06-ae9c-33dea5ece2d9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.689220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.690446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.690917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.691421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.692808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:27.694450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:27.696658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 196/387] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:27 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:27.701892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.747432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 192/388] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:27.762386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:27.823163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cb1e5-906a-4243-9c2b-cb2560ca2637 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.859097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.860398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.860871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.861353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/groups/99b770ef6a9044a18ce4e492fc39440e/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.863752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, group_id=99b770ef6a9044a18ce4e492fc39440e, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:27.865471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:27.884075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 197/389] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 21:26:27 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/groups/99b770ef6a9044a18ce4e492fc39440e/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:26:27.898776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2358302-569d-46da-8e9c-b67b26ddeac5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:27.936393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:27.937690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:27.938169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:27.938676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:27.951414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:27.960774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:27.961797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:27.962585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:27.965512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 193/390] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:27.971662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:28.082635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16af5-a831-43f0-96a5-e161177e57a7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:28.120052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:28.121195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.121668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.122182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.123294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:28.123823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:28.125440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:28.135298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 198/391] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:28.140992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:28.246319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b11d7-4450-479a-970e-63048aaaca78 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:28.288931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:28.290205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.290704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.291175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.292623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:28.294361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:28.296524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 194/392] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:28 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:28.303892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:28.413358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e493-c213-42cb-be38-3929478cf0b2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:28.447770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:28.448976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.449450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.449982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.451454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:28.453210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d79cc9-ccb3-4b55-89c6-58d2a9dfcfba None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:28.455438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 199/393] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:28 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:28.464795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:28.530546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc317-6df5-4049-a828-ed09d8230c64 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.530856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc317-6df5-4049-a828-ed09d8230c64 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.531078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fc317-6df5-4049-a828-ed09d8230c64 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.533343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 200/394] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:28.541134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.541541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.541917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.570008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:28.571176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:28.601304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee61a50-a71c-4d75-811b-2fc287003e03 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:28.673896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:28.675220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.675220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.675220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a/groups/99b770ef6a9044a18ce4e492fc39440e/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.681223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=437d0218d6364e47956b4a8911e3619a, group_id=99b770ef6a9044a18ce4e492fc39440e, role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:28.684637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:28.694092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 201/395] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:28.711556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 195/396] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 21:26:28 2022] PUT /identity/v3/projects/437d0218d6364e47956b4a8911e3619a/groups/99b770ef6a9044a18ce4e492fc39440e/roles/3f129043517b4e948ef87a9befee7394 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:28.733143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:28.855600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66037ed2-4b2a-4170-97b0-015acb933b47 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:28.895770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:28.896978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:28.897458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:28.897944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:28.912405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:28.920998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:28.921955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:28.922731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:28.927596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 202/397] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:28.933087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:29.038822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179355-0238-42f7-8b2a-22e465ca72f2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:29.073971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:29.074646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.074921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.075187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.075993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] RBAC: Adding query filter params (name=member) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:29.076296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:29.077671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:29.089634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 196/398] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:29.096381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:29.226552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb068d-0f37-42d5-a9be-28a4af17d6cc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:29.320643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:29.322123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.322123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.322123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.328375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:29.329586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:29.331590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 203/399] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:29 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:29.343404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:29.474077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ad53c-610f-4b8f-90d6-f662679e7a8a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:29.516175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:29.517414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.517891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.518392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.520259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:29.521924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04154e5-a8c3-47e9-ac48-403d1bd99147 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:29.524227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 197/400] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:29 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:29.529822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:29.557094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726df47-26ca-4590-b2f3-e9a0d85619c5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.557837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726df47-26ca-4590-b2f3-e9a0d85619c5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.558324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726df47-26ca-4590-b2f3-e9a0d85619c5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.560271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 198/401] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:29.566096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.566784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.567258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.611550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:29.611550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:29.761566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948b1c1-0fa2-41e6-848a-d9322da3ba45 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:29.767184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 199/402] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:29.801829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:29.817511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:29.818413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.818689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.818958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/groups/99b770ef6a9044a18ce4e492fc39440e/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.823409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, group_id=99b770ef6a9044a18ce4e492fc39440e, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:29.823409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e6b62-c19a-4af8-991d-1f7f90b03b57 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:29.852078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 204/403] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 21:26:29 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/groups/99b770ef6a9044a18ce4e492fc39440e/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:29.853730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f5fb-1e1f-4f15-91aa-22ded147a75c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.854015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f5fb-1e1f-4f15-91aa-22ded147a75c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.854287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880f5fb-1e1f-4f15-91aa-22ded147a75c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.855960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 205/404] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:29.863761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.864062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.864311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.887214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:29.889518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:29.947327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc81f0-9dc2-4c20-adba-fcbcf60e56e7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:29.985368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:29.986588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:29.987087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:29.987717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:29.994302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 206/405] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:30.001307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:30.010183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:30.011124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:30.011954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:30.014802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 200/406] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:30.016792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.021292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.123325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a65dc-9849-4be2-a310-fe6b5741dcce None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.126231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33977c7d-8c6a-4799-968e-461a88077f40 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.156712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.157512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.157789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.158060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.162024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.162912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.163420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.163911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.164870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:30.165370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.166931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.168466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:30.176382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:30.177290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:30.178103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:30.179234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 201/407] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:30.182014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 207/408] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:30.183197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.188449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.292703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eba262-b7d9-406a-a031-2e13678d029c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.297183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e5f10-f2b5-4683-bc41-532a17c92f96 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.326780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.327892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.328239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.328586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.330021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.330425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.331160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.331529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.331752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.331918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.332748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:30.333112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.334010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 202/409] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:30.336324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.344435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.356136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 208/410] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:30.362675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.509510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047a3f7-9f46-4018-b35a-fb03a64cb7df None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.530552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d065142-cbe5-4bac-9b3f-af92f03e6da9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.551292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.552134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.552416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.552690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.554712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.556205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.557926 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 203/411] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:30.565167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.595592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.596460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.596740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.597013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] PATH_INFO: `/v3/groups/ab5737040c9845d286e54e8c79f6089e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.598458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] RBAC: Authorizing `identity:get_group(group_id=ab5737040c9845d286e54e8c79f6089e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.600353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.602434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 209/412] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/groups/ab5737040c9845d286e54e8c79f6089e => generated 229 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:30.609085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.758151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c326a-5b85-4f04-ab2a-90635e512ddf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.774682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977a04a-bca9-4927-8bc1-c4f0afab94bc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:30.817979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.819644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.819931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.820211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/groups/99b770ef6a9044a18ce4e492fc39440e/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.822415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:30.823277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:30.823581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:30.823852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] PATH_INFO: `/v3/projects/69a58d85914b42b5b2db98febd6721c4` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:30.825617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc3bf884e4ea4f16aec60843fb7597a9, group_id=99b770ef6a9044a18ce4e492fc39440e, role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.827076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75687-177d-49a9-b2ed-812400e798b5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.830096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] RBAC: Authorizing `identity:get_project(project_id=69a58d85914b42b5b2db98febd6721c4)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:30.832568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:30.834404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 210/413] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:30 2022] GET /identity/v3/projects/69a58d85914b42b5b2db98febd6721c4 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:30.840780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:30.859520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 204/414] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 21:26:30 2022] PUT /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9/groups/99b770ef6a9044a18ce4e492fc39440e/roles/3f129043517b4e948ef87a9befee7394 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:30.975690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06a77d-f46c-440d-83ab-ee0d9586c947 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:31.015685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:31.016582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.016860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.017136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] PATH_INFO: `/v3/projects/69a58d85914b42b5b2db98febd6721c4/groups/ab5737040c9845d286e54e8c79f6089e/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.024577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=69a58d85914b42b5b2db98febd6721c4, group_id=ab5737040c9845d286e54e8c79f6089e, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:31.024577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d669c2d-9c9e-4a39-86f5-14a722edd6c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:31.047710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 211/415] 10.222.0.23 () {58 vars in 1442 bytes} [Wed May 4 21:26:30 2022] PUT /identity/v3/projects/69a58d85914b42b5b2db98febd6721c4/groups/ab5737040c9845d286e54e8c79f6089e/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:26:31.160780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285416-a9fc-46fb-8039-56a3517ee2f0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.161145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285416-a9fc-46fb-8039-56a3517ee2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.161334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71285416-a9fc-46fb-8039-56a3517ee2f0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.163099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 205/416] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:31.169152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.169769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.170266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.195402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:31.196984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:31.288734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 212/417] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:31.318106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71285416-a9fc-46fb-8039-56a3517ee2f0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:31.431896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71285416-a9fc-46fb-8039-56a3517ee2f0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:31.476230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:31.477085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.477361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.477638 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.492330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-a6d21fa0-c3b2-465a-841b-370d3aa8a8e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:31.500339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:31.501285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:31.502058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 206/418] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:31.509162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:31.660941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f34f8-ef84-41ca-b387-3bc22c5a205a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:31.702077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516e3b-a25f-4001-be25-6d45c7e9999e None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.702256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516e3b-a25f-4001-be25-6d45c7e9999e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.702535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a516e3b-a25f-4001-be25-6d45c7e9999e None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.703970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 207/419] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:31.709216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:31.709905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.710179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.710435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.710549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.710729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.710992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.711194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:31.711524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:31.713044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:31.724088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 213/420] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:31.729175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:31.748400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:31.749589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:31.830942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f7cd1-402f-46fc-9d79-e48520668788 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:31.843205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 208/421] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:31.883823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:31.884307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:31.885110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:31.885632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:31.886151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:31.957967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:31.959902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.035116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d3487-d888-449e-bed7-f005249b6ac1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.060727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 214/422] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:26:32.067439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.070021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.071237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.071237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.071475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.083723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:32.089821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:32.090719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:32.091624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:32.099459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 209/423] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:32.099459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.230920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e95c1f-dce4-4a3b-9b5e-26d29640bcbd None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.237455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b8573-ee33-4476-8061-09b0fe88cf69 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.277118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.277799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.278080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.278352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.279959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:32.280270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.281648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.296681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 210/424] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:32.302152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.319780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.320711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.321003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.321272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.322662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.324184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.326199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 215/425] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:32.332044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.445447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d11b7ec-5922-497b-aeb6-7e127829f0ea None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.483141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.483759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.484040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.484312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.519169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7ac2c-a8ee-4e48-ad85-460fe5502522 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.552284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.553791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.604989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.605865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.606138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.606404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.607691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.609122 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.611465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 216/426] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:32.627127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.661908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 211/427] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:32.668802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.772813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e529eb-d7ae-42e4-998f-a0f117fba19f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.808157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.809018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.809761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.810039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] PATH_INFO: `/v3/projects/437d0218d6364e47956b4a8911e3619a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.811236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=437d0218d6364e47956b4a8911e3619a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.812705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.814707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 212/428] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/projects/437d0218d6364e47956b4a8911e3619a => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:32.821138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:32.840341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f95e-ee94-4ce8-bd96-62940727bbc8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:32.882795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:32.883483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:32.883758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:32.884027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:32.884868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=437d0218d6364e47956b4a8911e3619a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:32.885176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:32.886609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:32.901903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 217/429] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:32.961615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa65c35-681e-4721-a17b-d1c54566d8d1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.025937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.026739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.027014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.027281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.028924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:33.031192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7434fc-8391-432a-a223-373ea8bc47f5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:33.033512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 213/430] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:32 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:33.041068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:33.159567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173a8ca-86d2-4cb8-94e0-7c548706427e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.196783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.197457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.197735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.198002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.198872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=437d0218d6364e47956b4a8911e3619a) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:33.199178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:33.200770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab68fd0-00bc-445b-b597-d8e95f80c26e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:33.208374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 218/431] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=437d0218d6364e47956b4a8911e3619a&role.id=3f129043517b4e948ef87a9befee7394 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:33.244244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9069-008b-4701-80b7-b84a7a4f57d3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.244550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9069-008b-4701-80b7-b84a7a4f57d3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.244793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9069-008b-4701-80b7-b84a7a4f57d3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.246510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 214/432] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:33.252176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.252467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.252716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.274486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:33.275739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:33.354637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 219/433] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:33.381489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9069-008b-4701-80b7-b84a7a4f57d3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:33.508601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9069-008b-4701-80b7-b84a7a4f57d3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.545356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.546239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.546516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.546782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.556969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-15f8f114-30e7-4bdd-9413-092a11c72424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:33.564825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:33.565753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 04 21:26:33.566557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:33.571051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 215/434] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:33.572635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:33.670035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c3ac-5aa7-41ee-a1e4-6b72715b0a23 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.670205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c3ac-5aa7-41ee-a1e4-6b72715b0a23 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.670467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860c3ac-5aa7-41ee-a1e4-6b72715b0a23 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.670649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c92e6-6252-433b-ae4f-84246ac1c901 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.672304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 216/435] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:33.677942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.678228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.678504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.704470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:33.706021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:33.718533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.719254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.719559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.719834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.720608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] RBAC: Adding query filter params (name=member) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:33.720910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:33.722399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:33.733931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 220/436] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:33.740652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:33.794675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 217/437] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:33.818747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:33.865716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43f00-ddf8-42d8-8645-0bca11259257 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.900896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.901550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.901826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.902094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.929784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5db986-14d6-41bd-b175-98cfc94e6dac None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:33.961572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:33.962380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.962660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.962936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.964029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:33.965478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e010e8-69b1-40cc-9acb-8d5c4d14e05e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:33.972980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-06a81570-7174-4000-9419-99b1d6f559d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:33.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:33.982234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:33.983051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 218/438] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:33.984284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a8149-c701-40a5-b8b8-afcef0318d9c None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:33.984284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a8149-c701-40a5-b8b8-afcef0318d9c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:33.984543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a8149-c701-40a5-b8b8-afcef0318d9c None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:33.985838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 219/439] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:33.988365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a8149-c701-40a5-b8b8-afcef0318d9c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.062698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 221/440] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:34.064026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.064313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.064584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.083662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:34.084840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:34.094710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a8149-c701-40a5-b8b8-afcef0318d9c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.127062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.127746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.128022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.128291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.129016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:34.129318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.130688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.138241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 220/441] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.138992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.147680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 222/442] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:34.148505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.241029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf214a-c472-409f-bbd2-a6c332c471b8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.244195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663b8b2-9856-404d-bbe2-a66822918b08 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.276274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.276923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.277201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.277474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.278321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.279245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.279559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.279829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.281035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.282503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.284201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 221/443] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.284940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.340454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.341972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.381632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846380-07f3-4853-a00f-b3b812e9a9f0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.413426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.414202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.414480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.414744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.424964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:34.432401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:34.433496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:34.434335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 222/444] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:34.435194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.445311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 223/445] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:34.446106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.531976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8efc7e0-afc0-47ad-8b3b-d5fbb0f46085 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.543922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96892a9a-9586-4fa5-8976-9eed274bfff4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.563194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.564070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.564349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.564616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.565818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.567252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.573911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 223/446] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.573911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.578300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.578968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.579246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.579550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.580310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:34.580611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.581973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.590037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 224/447] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.590810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.660947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761f8f8-83b9-4535-bf72-155a4c8b7fe2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.689003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038309e6-b7b9-4a73-b623-a00c6f50bb12 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.692760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.693612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.693895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.694166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] PATH_INFO: `/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.695346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] RBAC: Authorizing `identity:get_project(project_id=dc3bf884e4ea4f16aec60843fb7597a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.696787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.698460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 224/448] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/projects/dc3bf884e4ea4f16aec60843fb7597a9 => generated 302 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.699193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.720795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.721434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.721710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.721978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.722809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=1461cca390e245e2ad8f81a72e0dc6d3, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:34.723118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.724584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.730148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 225/449] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=1461cca390e245e2ad8f81a72e0dc6d3 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.730898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.800611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9ce55-efe2-4bc1-8c97-c856860651a1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.837411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.838557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.839046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.839338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.840966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea6562-5d41-4254-be34-3d08a214cafa None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:34.875730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:34.876964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:34.877243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:34.877512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] PATH_INFO: `/v3/groups/99b770ef6a9044a18ce4e492fc39440e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:34.878815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] RBAC: Authorizing `identity:get_group(group_id=99b770ef6a9044a18ce4e492fc39440e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.880302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.882154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 226/450] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/groups/99b770ef6a9044a18ce4e492fc39440e => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:34.888015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:34.910966 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:34.912453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:34.990803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db6d18-a121-487d-a72e-ea086c1d818d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:35.021945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 225/451] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:35.026214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:35.026875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:35.027159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:35.027266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:35.027502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:35.028411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] RBAC: Adding query filter params (group.id=99b770ef6a9044a18ce4e492fc39440e, role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:35.028728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:35.030193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:35.039425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 227/452] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:34 2022] GET /identity/v3/role_assignments?group.id=99b770ef6a9044a18ce4e492fc39440e&scope.project.id=dc3bf884e4ea4f16aec60843fb7597a9&role.id=3f129043517b4e948ef87a9befee7394 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:35.132334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785eb3f3-3a9d-426e-88e6-313e86616a60 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:35.167361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:35.168250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:35.168523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:35.168789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] PATH_INFO: `/v3/projects/69a58d85914b42b5b2db98febd6721c4` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:35.170040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] RBAC: Authorizing `identity:get_project(project_id=69a58d85914b42b5b2db98febd6721c4)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:35.171502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:35.173488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 226/453] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:26:35 2022] GET /identity/v3/projects/69a58d85914b42b5b2db98febd6721c4 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:35.179307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:35.281198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c15963f-5d0d-4a2f-b32c-1773210cc0c9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:35.313340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:35.314185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:35.314458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:35.314722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] PATH_INFO: `/v3/groups/ab5737040c9845d286e54e8c79f6089e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:35.315922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] RBAC: Authorizing `identity:get_group(group_id=ab5737040c9845d286e54e8c79f6089e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:35.317342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e983cc-d137-403c-a205-34e85359a5a9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:35.318916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 228/454] 10.222.0.23 () {56 vars in 1180 bytes} [Wed May 4 21:26:35 2022] GET /identity/v3/groups/ab5737040c9845d286e54e8c79f6089e => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:35.324857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:35.427804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7aec-f1f4-40c4-a3d5-d7dd6677394d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:35.458580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:35.459231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:35.459523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:35.459792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:35.460613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] RBAC: Adding query filter params (group.id=ab5737040c9845d286e54e8c79f6089e, role.id=1af302468b924833a9aea028857eac8d, scope.project.id=69a58d85914b42b5b2db98febd6721c4) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:35.460922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:35.462336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a27e2-7486-4b28-923f-b5d405a0e4a7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:35.468160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 227/455] 10.222.0.23 () {56 vars in 1376 bytes} [Wed May 4 21:26:35 2022] GET /identity/v3/role_assignments?group.id=ab5737040c9845d286e54e8c79f6089e&scope.project.id=69a58d85914b42b5b2db98febd6721c4&role.id=1af302468b924833a9aea028857eac8d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:38.184379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f097d4-fdc1-494b-8122-dc158c3713cb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.185030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f097d4-fdc1-494b-8122-dc158c3713cb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.185030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f097d4-fdc1-494b-8122-dc158c3713cb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.186880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 229/456] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:38.193084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5849-3e8c-4cb1-8db9-3083f3fd7e82 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.193604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5849-3e8c-4cb1-8db9-3083f3fd7e82 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.193604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5849-3e8c-4cb1-8db9-3083f3fd7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.216731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c5de5849-3e8c-4cb1-8db9-3083f3fd7e82 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:38.218309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c5de5849-3e8c-4cb1-8db9-3083f3fd7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:38.313620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 228/457] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:38.350265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f097d4-fdc1-494b-8122-dc158c3713cb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.372534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc777b-92d7-4261-90f1-5f5fc4cf2c9b None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.373160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc777b-92d7-4261-90f1-5f5fc4cf2c9b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.373653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc777b-92d7-4261-90f1-5f5fc4cf2c9b None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.375479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 229/458] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:38.380541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88967a0-297c-48bc-9f00-f8361202744a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.380820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88967a0-297c-48bc-9f00-f8361202744a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.381237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88967a0-297c-48bc-9f00-f8361202744a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.401627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d88967a0-297c-48bc-9f00-f8361202744a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:38.403207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d88967a0-297c-48bc-9f00-f8361202744a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:38.470751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 230/459] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:38.472485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619804-9d1d-48b6-8fe1-f5088e922324 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.472970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619804-9d1d-48b6-8fe1-f5088e922324 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.473477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf619804-9d1d-48b6-8fe1-f5088e922324 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.474934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 231/460] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:38.485999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.485999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.485999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.498548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f097d4-fdc1-494b-8122-dc158c3713cb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:38.502494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:38.503931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:38.537111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:38.538077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.538373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.538646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.552066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:38.554134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:38.577046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:38.578014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:38.578873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:38.578873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:38.578873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.578873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:38.581220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 230/461] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:38.582267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.585219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 232/462] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:38.593766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.685313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cd89fe-d7c3-4498-90dc-698c98d2c5bf None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:38.711593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba8601-bc07-4d6f-b3e9-e49f4c199185 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:38.720316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:38.721445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.721932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.722389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.733335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:38.735026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:38.745297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:38.745969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.746245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.746517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.747321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:38.747650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:38.749012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:38.754518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:38.755334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:38.756205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:38.756205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:38.756205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.756205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:38.758393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 231/463] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:38.759490 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.765389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 233/464] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:38.766287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.858249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb952e1-60da-4770-ac7d-006c72821e3b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:38.861661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7422d6-7679-4abf-b701-65bd18d7472d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:38.893422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:38.893771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:38.894080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.894363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.894632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.895349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:38.895492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.895666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.895781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:38.895941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.897020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:38.907609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:38.909214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 234/465] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:38.909323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:38.912214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-fb841a6e-274d-468f-a82b-30b69d6158ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:38.931002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:38.931916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:38.932754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:38.932754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:38.932754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:38.932754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:38.932754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 232/466] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:38.933456 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67077-36ee-42af-8337-8a15c1a20e30 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:38.933732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67077-36ee-42af-8337-8a15c1a20e30 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:38.933998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b67077-36ee-42af-8337-8a15c1a20e30 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:38.935491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 233/467] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:38.935997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67077-36ee-42af-8337-8a15c1a20e30 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.021566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac072eda-0bc3-4132-9872-09ae3b1e6e34 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.035347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b67077-36ee-42af-8337-8a15c1a20e30 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.059063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.060073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.060525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.060802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.061530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.062956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40611636-0a0d-4ea7-842f-a1c1de907bf1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.067694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.068363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.068635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.068899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.069591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.071025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.095408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 235/468] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:38 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:39.095408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.095408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.095408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.103264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 234/469] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:38 2022] POST /identity/v3/users => generated 248 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:39.104207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:39.104336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.105509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:39.179411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 236/470] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:39.216205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.277328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85526c-a21f-493f-bb49-6a7c39a872b4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.343141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.344252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.344729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.345193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.346142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:39.346729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.348370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.361482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 235/471] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:39.367071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.402731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01326f8a-81a4-4749-a7c8-4cc80d39780d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.448343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.449141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.449411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.449673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.461432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.462916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:39.483989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:39.484900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:39.485769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:39.485769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:39.485769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:39.485769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:39.486649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 237/472] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:39.492326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.498436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086db470-74d7-4c52-9c28-d2d194e8aabf None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.538519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.539184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.539511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.539788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.540688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.542157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.570836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 236/473] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:39 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:39.614120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f76d3-5af9-4cb4-9545-a6acb99a73b9 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.654864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.655568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.655849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.656129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.656870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:39.657174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.658588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b827f-f6d6-40c4-b2f4-76f62efb1d8a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.675544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 238/474] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:39.677257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.707742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58312261-f9dd-448b-b732-3f02f2c3fdda None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.708067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58312261-f9dd-448b-b732-3f02f2c3fdda None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.708294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58312261-f9dd-448b-b732-3f02f2c3fdda None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.709982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 239/475] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:39.715647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.715988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.716251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.733922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:39.735127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:39.807499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 240/476] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:39.832266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:39.834622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3a62a-0412-42e1-89c5-053343920f1c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.877016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.877701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.877983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.878257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.879341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.881132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.909505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 237/477] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:39 2022] POST /identity/v3/users => generated 249 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:39.938551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0db56-5997-434a-8104-475ef1bd9972 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:39.974824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:39.975872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:39.976339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:39.976795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:39.977900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:39.979747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:39.988776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.sql.core [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:26:39.988776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 21:26:39.988776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [parameters: {'id': '80938af117964c47ba681714feb29e6e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 21:26:39.988776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80010) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application conn.query(q) May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result.read() May 04 21:26:40.006854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return ref.to_dict() May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:26:40.007842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application next(self.gen) May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application yield resource May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application next(self.gen) May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise self.value May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application session.commit() May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:26:40.008725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.session.flush() May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application compat.raise_( May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:26:40.009602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:26:40.011268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application conn.query(q) May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result.read() May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:26:40.013253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [parameters: {'id': '80938af117964c47ba681714feb29e6e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:40.015164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 04 21:26:40.017258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:40.021195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 241/478] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 21:26:39 2022] POST /identity/v3/roles => generated 144 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:40.027596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:40.177427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e02440c-1a3a-498a-b1fb-395564a6c4a2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:40.215688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:40.216508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:40.216785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:40.217051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:40.228565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-ca4aa37f-81f2-43f4-af1e-159ddc2cd70e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:40.236655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:40.237547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:40.238326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 238/479] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:26:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:40.243617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:40.350903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965aba-3b0e-496f-bf21-cf445b4e4237 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:40.384552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:40.385230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:40.385511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:40.385782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:40.386548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:40.386848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:40.388299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84dba83-097b-411f-8a22-d650a49f2ec2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:40.397339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 242/480] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:41.750165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25708-0408-4858-9292-3eed774185fa None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:41.750792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25708-0408-4858-9292-3eed774185fa None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:41.750792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df25708-0408-4858-9292-3eed774185fa None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:41.752540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 239/481] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:41.758179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce599c-a3bd-4711-ae30-de1bab7917eb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:41.758681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce599c-a3bd-4711-ae30-de1bab7917eb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:41.758756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce599c-a3bd-4711-ae30-de1bab7917eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:41.776030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-53ce599c-a3bd-4711-ae30-de1bab7917eb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:41.777209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-53ce599c-a3bd-4711-ae30-de1bab7917eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:41.844609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 243/482] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:41.879971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25708-0408-4858-9292-3eed774185fa None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:41.972424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d38aa-eac3-4dce-8f82-f2fe701870d3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:41.972830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d38aa-eac3-4dce-8f82-f2fe701870d3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:41.972995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d38aa-eac3-4dce-8f82-f2fe701870d3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:41.974669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 244/483] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:41.979614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:41.979898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:41.980175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:41.998210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:41.999402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:42.035734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df25708-0408-4858-9292-3eed774185fa None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.074309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 245/484] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:42.097608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.104174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.104999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.105274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.105546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.130154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:42.137937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:42.138830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:42.139662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:42.143899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 240/485] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:42.150334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.196024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2eadd3-7171-4fea-8ca0-7413f70d7120 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.229330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.230138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.230419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.230692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.244744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:42.250173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:42.251159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:42.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 246/486] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:42.257765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.316308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f417dc00-6bc4-4337-ad72-596b555272a5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.356415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.357104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.357377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.357644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.358415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:42.358711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.363350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.382550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 241/487] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:42.388257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.435658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4daa63-612b-45a0-9c1e-8fc8ee899468 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.491668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.492774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.493304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.493797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.494753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:42.495253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.495493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea2a713-f8d0-4a6f-9622-58af7b7f0c20 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.497120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.515547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 247/488] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:42.521937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.540458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.541267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.541548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.541820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.556592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.558492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a94652f8-67db-49b5-b119-fc0e2b3e4dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:42.580795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:42.581721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:42.582565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:42.582565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:42.582565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:42.582565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:42.584984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 242/489] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:42.586699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe21e-cd85-41d3-9394-672ea4f795db None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.587130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe21e-cd85-41d3-9394-672ea4f795db None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.587556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe21e-cd85-41d3-9394-672ea4f795db None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.593446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 243/490] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:42.593446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe21e-cd85-41d3-9394-672ea4f795db None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.640813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9dc2-8f04-425a-9ffb-64ac641a8ae8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.675148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.675989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.676266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.676540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.687012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.688499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-69319990-10b0-4983-9dd5-b3d9b030c33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:42.705152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:42.706018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:42.706880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:42.706880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:42.706880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:42.706880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:42.711027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 248/491] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:42.712333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.712619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.712901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.713532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe21e-cd85-41d3-9394-672ea4f795db None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.730260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:42.731614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:42.754623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.755974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.756436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.756769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.757663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:42.757971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.760037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.772261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 244/492] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:42.773088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.801136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 249/493] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:42.802014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.881286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3b54-f1db-4a05-9e72-0ba4b85b058b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.906857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92f64b-5327-4d46-9eea-4c959dcba8ea None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:42.914654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.915405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.915711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.915986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.916716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:42.917019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.918393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.930338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 245/494] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:42.931161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:42.946000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:42.946879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:42.947159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:42.947487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:42.955491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:42.957015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:42.973748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:42.975896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 250/495] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:42.978134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.034241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91c0bc-34e3-44f8-9290-c6cbb3010f4d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.067968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.068762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.069037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.069305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.075952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bd70-ef00-4e78-968e-92fadb6637f1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.079597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:43.087206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:43.088232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:43.089003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 246/496] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:43.090233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.113781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.114575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.114851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.115120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.122107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.123575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ffbd6b14-6b74-4353-b907-8b38bfe69e43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:43.137946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:43.139098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:43.140037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 251/497] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:43.140606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5048bb-5243-4ed3-8069-60ef93600889 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.140670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5048bb-5243-4ed3-8069-60ef93600889 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.140901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5048bb-5243-4ed3-8069-60ef93600889 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.146400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 252/498] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:43.147167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5048bb-5243-4ed3-8069-60ef93600889 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.191846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dc926-e112-4229-a9e6-f2e5d59c4e4a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.223917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.224869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.225332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.225811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.226861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:43.227353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.229064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.245058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5048bb-5243-4ed3-8069-60ef93600889 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.273270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 247/499] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:43.274537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.284922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.285589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.285867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.286132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.286873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:43.287259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.288558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abf127-e151-43b6-97ad-62ffb14b6147 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.296521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 253/500] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:43.297771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.298055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.298323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.314068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:43.315237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:43.375139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8c793-3ae0-48c9-a9d2-97ab3ab7140d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.379629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 254/501] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:43.380616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.413502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.414089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.414364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.414638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.415493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:43.415801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.417221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.433835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 248/502] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:43.434714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.480867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88514d6-8c0d-462a-b93b-f5316ba8d7d3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.513755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.514410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.514665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.514930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.528952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8eaae6-6a69-4730-8c41-ccc857b2fd95 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.561238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.562027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.562304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.562578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.572299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.573752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.577401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.578835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c171285-798b-4871-bdfc-dc26279cb246 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:43.590701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:43.591571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:43.592411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:43.592411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:43.592411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:43.592411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:43.592411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 249/503] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:43.592996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.680335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 255/504] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:43.681761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59325e37-6f5c-4444-8088-edaed3413f23 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.682019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59325e37-6f5c-4444-8088-edaed3413f23 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.682290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59325e37-6f5c-4444-8088-edaed3413f23 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.683578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 256/505] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:43.684286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59325e37-6f5c-4444-8088-edaed3413f23 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.685289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86138b92-04b3-49a5-b4ee-55919f7e82ce None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.718792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.719631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.719914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.720189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.730041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:43.737802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:43.738716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:43.739525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 250/506] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:43.740195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.784391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59325e37-6f5c-4444-8088-edaed3413f23 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.815839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.816476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.816751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.817027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.838678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b921c-b4ec-4c99-8804-002e6f1a51d7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:43.872476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:43.873137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.873415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.873692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.874409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:43.874720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.876128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece8319-c737-45dd-b181-a3d3502545ab None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.883526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:43.884968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:43.887337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 251/507] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:43.888540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:43.888822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:43.889094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:43.904555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:43.905738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:43.966647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 252/508] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:43.967837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:43.979554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 257/509] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:43.980427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.064819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b97c-4fd9-4106-b5e6-f1cbb0ba442c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.075480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036c36e-b275-4888-b867-6d24ee00f2a3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.099311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.100149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.100429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.100698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.107404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.108066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.108347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.108619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.109359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.109662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.110623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.111030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.112096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.123547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 258/510] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.123547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:44.129077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.130103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 253/511] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.131143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.221247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c9673-30ba-4659-b62d-06b6fb39bb92 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.227856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47229e1-9dbb-41c4-850d-39d762c26d3b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.253866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.254974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.255840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.255840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.260375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.261158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.261431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.261695 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.263242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.264746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.271656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.273095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:44.278620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.279688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 259/512] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.280643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:44.291897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.292902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 254/513] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.293956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.377500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f56bc9-9355-4a5c-b20f-75d5215d0cfd None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.383907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69589ef6-99e8-4198-be47-76287ef48f94 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.409886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.410662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.410936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.411200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.417554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.418323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.418640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.418916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.421331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.422764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.428849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.430271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:44.439068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.440011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.440847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:44.440847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:44.440847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.440847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:44.441320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 260/514] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.443721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:44.456357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.457283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.458098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:44.458098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:44.458098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:44.458098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:44.458098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 255/515] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.458349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.543681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e554c1-215d-4033-bdd4-f62afd39a6b3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.556704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0a9e9-921e-4674-b2b7-5dabfcd4f9c0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.578923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.579608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.579862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.580149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.580858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.581154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.582518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.589738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.590420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.590688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.590954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.591812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.592114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.593837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.594228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 261/516] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.594982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.610474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 256/517] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.611261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.689102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d242d-5ba2-48c8-8b88-d051da3d2d17 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.701112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ec4-59e2-41aa-869b-41a8b8c0a9af None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.722251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.722898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.723171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.723452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.724162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.724461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.725814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.733912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.734555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.734830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.735096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.735844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.736144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.736447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 262/518] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.737198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.737535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.748528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 257/519] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.749309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.831093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d404de4-9348-4929-9e59-70fef2269d2b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.848231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57dda5-fd1a-487b-ad6b-376f12f0eeb3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:44.864613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.865740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.866237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.866669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.867719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:44.868025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.869403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.880752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 263/520] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:44.881485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.881847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:44.882634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:44.882912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:44.883184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:44.889935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:44.891367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:44.905753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:44.906779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:44.907712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:44.911498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 258/521] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:44.912318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:44.976284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676cbd8-b4b9-4569-899e-f819e5da3674 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.005004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c1af5-8fe9-422e-8f24-e3569d02b61e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.010282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.010925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.011200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.011496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.037364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.038148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.038419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.038683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.045252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.046694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:45.060401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:45.061263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 259/522] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:45.062748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.075897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.077354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.156809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af613d-098a-4eee-85af-14951bed8291 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.169114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 264/523] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:45.169897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.189984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.190640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.190917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.191179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.191901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.193318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.212872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 260/524] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:26:45 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:26:45.213655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.279462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a2191-a380-4d7e-b143-ac16ad2adb0f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.316045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.316888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.317160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.317430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.325338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.326796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.331617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e92b4-c281-43b5-ad62-da7a1d4860d3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:45.343012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:45.344238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:45.345123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 265/525] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:45.345672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.371397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ae23-d305-4634-973d-18e23489978a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.372181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ae23-d305-4634-973d-18e23489978a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.372461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ae23-d305-4634-973d-18e23489978a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.372792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162ae23-d305-4634-973d-18e23489978a None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.373537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162ae23-d305-4634-973d-18e23489978a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.373848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162ae23-d305-4634-973d-18e23489978a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.375331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162ae23-d305-4634-973d-18e23489978a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.393571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 261/526] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.394415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ae23-d305-4634-973d-18e23489978a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.455294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ce82-1da7-4789-ba3e-61a20cdb9df1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.492899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.493585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.494094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.494221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.494901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.495203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.496700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162ae23-d305-4634-973d-18e23489978a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.496803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.514096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 266/527] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.519018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.528605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.529406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.529685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.529959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.539725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.541170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:45.558470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:45.559591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:45.560428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:45.560428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:45.560428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:45.560428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:45.560428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 262/528] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:45.561158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.614581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc5b00-7b88-412b-ad07-a076c3920f74 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.646865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.647555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.647832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.648104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.648955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.649263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.650700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.656896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9017-e49d-41c2-a6ed-4d413df79861 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.687754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 267/529] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.688873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.694201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.694863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.695142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.695435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.696272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.696581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.698022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.703667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 263/530] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.704421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.803751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6182cff-420a-4084-bd83-65b7c76f47fe None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.808404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc37255-bacc-40d4-91e9-44f09b24514f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:45.844594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.845317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.845547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.845822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.846794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=41e2d642d4db4a7f92fd6b45ebb5f8f9) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.847115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.848670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:45.849130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.850026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:45.850494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:45.850947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:45.852080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:45.852582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:45.854211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:45.862448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 268/531] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/role_assignments?user.id=41e2d642d4db4a7f92fd6b45ebb5f8f9&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.863549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.872529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 264/532] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:45.881437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:45.975893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9711d3-cfc8-4576-83e1-8f13c904cb03 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.003341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385b4e9-5957-4919-a9b9-1f079d65bd7a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.014592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.015660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.016130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.016586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.038964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.040129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.040129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.040320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.047632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.049076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:46.063541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:46.064594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:46.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 265/533] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:46.070805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.090473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.092297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.172251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fec1df-e4aa-4626-979f-d5f5b2d33dfe None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.192602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 269/534] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:46.200112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.215881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.216514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.216794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.217064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.218174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:46.218479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.219944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.233522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 266/535] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:46.240027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.302155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2db04-a9be-4e13-89af-9639230aa344 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.335847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.336646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.336926 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.337204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.339705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5656b1-24ca-4e97-a124-fa63a28fea91 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.347851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.349332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:46.366940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:46.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:46.369180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:46.369180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:46.369180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:46.369180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:46.369180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 270/536] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:46.373847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.374380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.375083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.375371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.375659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.376549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=93f8c6e46f6d4cc8a3364bfa3e6b93d8) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:46.376855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.378302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.384400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 267/537] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/role_assignments?user.id=93f8c6e46f6d4cc8a3364bfa3e6b93d8&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:46.482337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f7a5b-705a-479e-9e56-6f905aa52ddc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.517137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.517818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.518099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.518371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.519110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:46.519440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.520888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.533897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 271/538] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:46.539525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.668852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e815e-34e4-4263-9efb-17b212d6545b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.717373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.718478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.718757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.719024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.730163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.731733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:46.746345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:46.748353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:46.750319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 268/539] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:46.753715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:46.854921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f0728-cb72-43e0-972f-da7b4c43a27a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:46.902340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:46.903079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:46.903357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:46.903649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:46.904446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:46.904813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:46.906246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93fab8-d98c-43ad-92ad-dbc00ccdc02b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:46.922193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 272/540] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:46.928191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:47.073707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00f160-8864-4bc5-ad70-45fb0238d121 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:47.121014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:47.121773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:47.122048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:47.122314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:47.123153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a3aa6a22bd7c49679c84f824f43aca30) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:47.123507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:47.124947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24259513-7c56-4392-94cf-77621aaa0e7d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:47.135688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 269/541] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:46 2022] GET /identity/v3/role_assignments?user.id=a3aa6a22bd7c49679c84f824f43aca30&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:47.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755cc14-52d5-4962-a2b9-cbdb27700635 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:47.627187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755cc14-52d5-4962-a2b9-cbdb27700635 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:47.627356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755cc14-52d5-4962-a2b9-cbdb27700635 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:47.629026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 273/542] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:47.642148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:47.642670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:47.643131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:47.672652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:47.674172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:47.747744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 270/543] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:47.796884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755cc14-52d5-4962-a2b9-cbdb27700635 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:47.925469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755cc14-52d5-4962-a2b9-cbdb27700635 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:47.968887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:47.970052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:47.970547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:47.971004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:47.982384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:47.990322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:47.991191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:47.992008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:47.994637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 274/544] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:48.000381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:48.118243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cc704-ed2c-43ea-8c42-befe2af00923 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:48.158748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:48.159480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.159717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.159986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.160737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:48.161034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:48.162410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:48.175262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 271/545] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:48.177034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:48.354591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734449b-dcb7-4f2d-8080-f2cfd96cc6d1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:48.399740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:48.400538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.400816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.401085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.416014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:48.417464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:48.439676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:48.440546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:48.441377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:48.441377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:48.441377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:48.441377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:48.441377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 275/546] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:48.446544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:48.606048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e920-e6eb-4805-840c-296b7722b435 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:48.656973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:48.657646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.657924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.658194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.658926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:48.659316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:48.660710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b360deb-aec1-4f50-881f-ffc32bb7cead None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:48.674048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 272/547] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:48.679845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:48.686171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac67d-920b-4b54-8545-2b486eb40846 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.691220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac67d-920b-4b54-8545-2b486eb40846 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.691220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ac67d-920b-4b54-8545-2b486eb40846 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.691220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 273/548] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:48.698857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73dc5-13c5-4916-99e1-d0045ad2f2bb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.699138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73dc5-13c5-4916-99e1-d0045ad2f2bb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.699431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df73dc5-13c5-4916-99e1-d0045ad2f2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.715696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9df73dc5-13c5-4916-99e1-d0045ad2f2bb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:48.716857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9df73dc5-13c5-4916-99e1-d0045ad2f2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:48.791411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 274/549] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:48.791411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bfb5a-e30e-4aa1-ba08-fd29a6b65265 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.791411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bfb5a-e30e-4aa1-ba08-fd29a6b65265 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.791411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bfb5a-e30e-4aa1-ba08-fd29a6b65265 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.791411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 275/550] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:48.795544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.795829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.796105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.821041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:48.822200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:48.825931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f776fd-2d6e-44b7-95f1-f7f37840e3fe None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:48.867710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:48.869388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:48.870002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:48.870539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:48.881531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:48.883530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:48.895407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:48.895407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:48.910886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:48.911854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:26:48.912726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:48.914970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 276/552] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:48.916337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.005027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f812c8a-9f01-4104-9ad8-a7dea169ae90 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.015624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af3166-f937-4478-b24c-183571460d0f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.037835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.038632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.038906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.039173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.049955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:49.052302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.053344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.053811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.054285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:49.058347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.059317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.060440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:49.065033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 277/553] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.066059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.070520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:49.078836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.079852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.080621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:49.086414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 277/554] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.086414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.173909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e0d45-3827-4877-b977-8978d4b229bc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.204769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e30cb-fd02-4ab5-8c1c-7291da32d73e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.207908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.208575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.208846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.209112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.209954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:49.210256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.211725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.233705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 278/555] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:49.234578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.256135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.256764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.257033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.257296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.258039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:49.258339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.260593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.270921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 278/556] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:49.271812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.338500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d1fb9-c8a8-4184-8d66-f9c7929c2729 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.368339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5189671b-e9d2-42d2-96d6-0e1cba144f14 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.373243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.374080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.374502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.375321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.376240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:49.377036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.379017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462060f9-5341-44fe-a236-47ed888ad9c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.390247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 279/557] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:49.391625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f5ed-e43d-42e8-92cf-19b6aee2f7e9 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.391910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f5ed-e43d-42e8-92cf-19b6aee2f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.392183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8f5ed-e43d-42e8-92cf-19b6aee2f7e9 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.393800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 280/558] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:49.394489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f5ed-e43d-42e8-92cf-19b6aee2f7e9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.407536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.408203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.408616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.408892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.473035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.474466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca911a-b84f-4ed8-a78d-d6d317bd9840 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.495989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8f5ed-e43d-42e8-92cf-19b6aee2f7e9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.529424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.532877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.533161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.533433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.544136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.545580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:49.563507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.564394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.565467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:49.565467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:49.565467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.565467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:49.565467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 281/559] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.565747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.579061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 279/560] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:49.584792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.585078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.585349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.601414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:49.602578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:49.663246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d77dc5-aae9-43c4-9e89-815a900d434d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.675396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 280/561] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:49.675396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.707016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.708473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.709046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.723682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.725265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:49.743691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.744685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.745547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:49.745547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:49.745547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.745547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:49.745547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 282/562] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.745809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.769571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac2539-17b8-49d9-b58f-927f6721ec8f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.802847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.803873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.804354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.804682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.805407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:49.805707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.807060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.821861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 281/563] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:49.822866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.849803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d517d1-02e2-463a-bc32-cd1d13b7b83a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.882118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.882915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.883193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.883496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.893887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:49.895327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:49.912408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.913839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 283/564] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:49.926746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d955-dfc4-4429-bfd6-fccb0e1cd062 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:49.957971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:49.958773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:49.959054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:49.959321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:49.969696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:49.977347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:49.978297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 282/565] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:49.984370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.007889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc1e3-a4b0-4023-bbd5-bd2b8f416e31 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.040234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.040878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.041151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.041417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.042136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.042431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.043875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575fab0-7428-474e-b65a-e33b79d84c8f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.055131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 284/566] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.056343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea498a6-2ce1-4634-a499-15d8b532b1a3 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.056635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea498a6-2ce1-4634-a499-15d8b532b1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.056880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea498a6-2ce1-4634-a499-15d8b532b1a3 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.058232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 285/567] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:50.058787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea498a6-2ce1-4634-a499-15d8b532b1a3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.074972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f55468-ec77-40eb-a9c9-012f702b2af5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.106345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.107234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.107594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.107864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.115274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.116739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:50.130575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.131686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:50.132717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 283/568] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:26:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.133298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.156479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea498a6-2ce1-4634-a499-15d8b532b1a3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.188288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.188943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.189221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.189496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.190218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.190520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.191923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.202688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 286/569] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.207356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.228506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0152ee2-773a-48c1-852b-2402b6915ec2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.261383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.262196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.262542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.262814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.263600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.263904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.265275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157b0b5-4878-4b8e-9bf1-f8af899c56ed None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.273042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 284/570] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.274230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.274515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.274790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.291628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:50.292807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:50.297207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c65f5f-3082-4884-92a6-a446c37003e3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.328249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.329042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.329323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.329593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.336986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.338467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:50.353852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.354874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:50.361214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 287/571] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.361935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 285/572] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:50.362020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.362095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.447838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c38c-5f0e-40a8-828f-e8089e21e912 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.461521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00fcfc2-8928-4c25-90bf-879fd66619b2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.482254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.483041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.483316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.483611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.490565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.492050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.493270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.493929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.494204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.494496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.495321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.495649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.497088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:50.506343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.507282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 286/573] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.513571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.514171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 288/574] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.514774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.600770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87797848-c11c-4029-8b77-ca27a9b079bf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.615297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a88395-602f-401f-979c-3341142f1e0c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.634265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.635048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.635282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.635614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.645955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.647397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.647969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.648624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.648903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.649175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.650015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.650321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.651751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:50.663773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.664854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.665807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:50.665807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:50.665807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:50.665807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:50.665807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 287/575] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.666079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.669905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 289/576] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.670714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.761166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e4f66-dba5-4875-afba-31360a0e229b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.765446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b477e1b-1103-4d9d-88b1-30277dc6f7bf None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.794209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.794978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.795281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.795582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.798373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.799009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.799284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.799575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.800339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.800636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.802041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.805538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:50.813337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 290/577] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:50.813698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.814644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:50.815971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:50.816609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.816680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 288/578] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.816680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.914943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3d77e-f981-4549-9997-ca6debde6c54 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.917025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d877d2-379d-4168-b801-e3211b363bc3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:50.948011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.948648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.948928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.949206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.949802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:50.949975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:50.950263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.950573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:50.950845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:50.951116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:50.951659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.961331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:50.962748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:50.963108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 289/579] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:50.963941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:50.983468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:50.984511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:50.985406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:50.985406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:50.985406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:50.985406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:50.985406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 291/580] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:50.985682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.056717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90bab1-fb72-4882-adec-7bc6c2a21d11 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.088007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a000ed-2a82-4a99-abac-379d291be06e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.090293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.091088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.091364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.091775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.102700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.104256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.121259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:51.121593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.122605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.123541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:51.123541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:51.123541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.123541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:51.123777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.123777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.123777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.123952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 290/581] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.124028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=cb0727d888284c15a4eb6fd7126f7d3e) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.124028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.124153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.124986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.130967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 292/582] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:50 2022] GET /identity/v3/role_assignments?user.id=cb0727d888284c15a4eb6fd7126f7d3e&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.131204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.234862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7cfce-6371-4f12-adaf-5eb2410cb99a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.242197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045c3af-6971-4537-bea8-f68a9169a444 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.275374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.276243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.276593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.276971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.277804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.278197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.278394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.279256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.279638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.279868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.280044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.289007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.294418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 291/583] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.294614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.294707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:51.310273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.311534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 293/584] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.312678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.412461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8754dc-bab4-4b43-b97d-03c798ae10fa None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.428625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e40813-cfad-4013-9012-0df36efdd9ae None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.456679 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.457901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.458474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.459059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.460422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.461031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.462688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.466441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.467142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.467767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.468031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.468749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.469050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.470387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.480795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 292/585] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.480795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.485893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 294/586] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.490845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.574042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9298f26-17e4-4096-ab28-35c31ec4634b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.590017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5014b-a91b-4b17-bdce-585c58422236 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.609269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.610771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.611306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.611759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.622494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.622964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.623750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.623959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.624214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.624590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.625517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.625917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.627421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:51.640815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.641939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 293/587] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.647909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.650743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 295/588] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.655340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.745186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c60204-bbc4-4c35-865c-d41968ea3f14 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.756856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784145-976a-4ebe-9040-a5104fcd007d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.777715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.778547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.778808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.779094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.785844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.787438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.793925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.794705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.794980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.795250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:51.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.802228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:51.803138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:51.804238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.804238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.807235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 294/589] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.808095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:51.817067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.817988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 296/590] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.819261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.908276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693c854-9cb8-4c7c-8a85-c905f2e590ff None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.917711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec492-08d3-4dac-8da6-9ea44b475abe None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:51.943400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.944102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.944393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.944647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.945368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:51.945668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.947023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.951594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:51.952609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:51.953054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:51.953485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:51.963526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 295/591] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:51.964649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:51.965463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:51.966937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:51.984348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:51.985293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:51.986183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:51.986183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:51.986183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:51.986183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:51.986183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 297/592] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:51.986564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.062055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fed32f-2712-4290-9364-f2b6de803e12 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.088793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d2216-1c41-4e86-ab7a-1caefbe13eeb None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.097544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.098358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.098681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.099045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.099981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:52.100694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.101949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.113754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 296/593] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:52.114746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.124910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.125703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.126075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.126773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.127324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:52.127748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.129274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.146412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 298/594] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:52.147253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.210793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6011d6-ac12-47f4-90c1-d1be13e1d5fc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.248311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.249167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.249440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.249706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.253862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e0129-336c-4b09-8890-7e42d31b77e7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.259868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:52.274070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:52.275217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 297/595] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:52.280853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.288701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.289571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.290007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.290391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.291416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:52.291544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.292972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.304611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 299/596] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:52.305264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.380084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544466e3-8e35-4b16-8042-d70e6c2839c4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.398909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a75c6-ea7b-44ac-a553-d56416822ba1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.414096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.415113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.415520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.415894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.429672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.430197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=0916e52c6c48499588ca68d970588ee7, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.430552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.430828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.431097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/41e2d642d4db4a7f92fd6b45ebb5f8f9/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.432045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.445245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=41e2d642d4db4a7f92fd6b45ebb5f8f9, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.455795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 298/597] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:52 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:52.456030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.456141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.472417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 300/598] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:52 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/41e2d642d4db4a7f92fd6b45ebb5f8f9/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:52.473555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.565349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7f5fc-3850-4b96-a05a-8f363b0073bf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.606521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d39b0-5c83-4a73-a393-d5c3db0d8ed7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.619281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aad848-d0d5-4648-b601-46279881feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.620151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aad848-d0d5-4648-b601-46279881feac None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.620500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aad848-d0d5-4648-b601-46279881feac None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.620896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aad848-d0d5-4648-b601-46279881feac None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.621891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aad848-d0d5-4648-b601-46279881feac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:52.622311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aad848-d0d5-4648-b601-46279881feac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.623931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aad848-d0d5-4648-b601-46279881feac None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.648641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.649782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.651188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.651594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.660253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.662076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.665752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 299/599] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:52.671422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aad848-d0d5-4648-b601-46279881feac None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:52.678976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:52.680152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:52.681242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:52.687859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 301/600] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:52.690387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.824508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145cb4d-8b6f-438b-ba6f-96c125c5e365 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.833982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aad848-d0d5-4648-b601-46279881feac None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:52.861002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.861955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.862424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.862876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.863932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:52.864450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.866083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.873682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:52.874481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:52.874759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:52.875520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:52.881070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 302/601] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:52.889879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:52.890583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:52.895417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:52.926890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:52.927846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:52.928735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:52.928735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:52.928735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:52.928735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:52.934536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 300/602] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:52.940090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.045555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8223425-0aae-4d12-b4d3-db7ff6ed0ee0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.087563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.088522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.088777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.089047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/93f8c6e46f6d4cc8a3364bfa3e6b93d8/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.090403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee17913a-9365-4b13-acc2-330d5154c364 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.116717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=93f8c6e46f6d4cc8a3364bfa3e6b93d8, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.118225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.125491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.126756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.127288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.127796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.128738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:53.129237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.130845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.143216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 301/603] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:53.149018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.149907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 303/604] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:52 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/93f8c6e46f6d4cc8a3364bfa3e6b93d8/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:53.253936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18e47c-9b67-4039-847f-006d37aa4ebe None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.293491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.294314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.294589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.294857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.302721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.304221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f885d46c-7731-4305-bd5f-7b4c62c1aaa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:53.319325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:53.320321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:53.321219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 302/605] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:53.326625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.459775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1714ed8d-1a95-408c-b065-d3360bfbb796 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.467676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a4791-442a-4ea5-960d-3c98d4b07aed None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.468321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a4791-442a-4ea5-960d-3c98d4b07aed None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.468836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a4791-442a-4ea5-960d-3c98d4b07aed None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.470672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 303/606] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:26:53.476462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.477054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.477550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.500437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:53.502191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:53.516761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.517772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.518291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.518773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.519868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:53.520383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.524137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.546253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 304/607] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:53.553008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.596772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 304/608] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:53.622366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.694967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feada980-ed6d-4b36-98e6-6b8cbf4418ff None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.736102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbac13-118b-48ee-a3e9-515c7a73e473 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.767871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.769489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.770460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.771415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a3aa6a22bd7c49679c84f824f43aca30/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.774608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.775660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.777401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.777960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.799020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:53.804920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=a3aa6a22bd7c49679c84f824f43aca30, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.806615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:53.813852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:53.814874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:53.815742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:53.819008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 305/609] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:26:53.825067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:53.835854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 305/610] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:53 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a3aa6a22bd7c49679c84f824f43aca30/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:53.940180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e12456-bc5a-4bf8-92f3-15ab07bf50be None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:53.984365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:53.985065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:53.985345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:53.985619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:53.986388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:53.986693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:53.988104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:53.997180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 306/611] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:26:54.002815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:54.108860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cd6a-8343-45ef-a3ee-16f01c4b95a9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:54.150430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:54.151247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:54.151553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:54.151833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:54.165914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:54.167400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:54.202082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:54.203061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:54.204003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:54.204003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:54.204003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:54.204003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:54.204003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 306/612] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:54.210657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:54.326057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76783ed-cee5-4044-a981-e9938f19e60d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:54.373196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:54.373986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:54.374170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:54.374320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:54.375026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:54.375329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:54.376749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:54.388835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 307/613] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:54.400730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:54.512337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afec58a-c885-443d-bdaa-ca26d299076d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:54.546183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:54.546985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:54.547265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:54.547570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:54.554982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:54.556452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:54.571141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:54.573312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:54.575441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 307/614] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:54.582693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:54.712030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cc9ad-f7d6-4845-aa7c-08e7f917160a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:54.752958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:54.753631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:54.753909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:54.754181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:54.755016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:54.755323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:54.756887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:54.782843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 308/615] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:54.788826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:54.902691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f15707-f527-4c54-85fc-dddff0123eba None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:54.935979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:54.936775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:54.937055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:54.937330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:54.947460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:54.948917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:54.966782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:54.969156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:54.971145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:54.971145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:54.971145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:54.971145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:54.971145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 308/616] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:54.977136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.076623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749231-24f3-4fcf-a5da-d45ab96bfe96 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.109536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.110206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.110485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.110760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.111536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:55.111844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:55.113218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:55.125514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 309/617] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:55.132853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.279132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f4956-0891-4845-8687-950329d1807a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.329416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.330217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.330496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.330764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.340526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:55.341983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-9c9f3ac1-5615-416e-a0c6-6919b9b3093e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:55.359561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:55.360460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:55.361341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 309/618] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:55.367991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.416589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123517-6ad3-4941-a5ac-2a79b609f6ff None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.416882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123517-6ad3-4941-a5ac-2a79b609f6ff None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.417128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b123517-6ad3-4941-a5ac-2a79b609f6ff None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.418770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 310/619] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:55.425312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ecdfb-6b3d-4987-a784-e3b6b0c989ee None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.425590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ecdfb-6b3d-4987-a784-e3b6b0c989ee None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.425868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ecdfb-6b3d-4987-a784-e3b6b0c989ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.443769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a01ecdfb-6b3d-4987-a784-e3b6b0c989ee None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:55.444960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a01ecdfb-6b3d-4987-a784-e3b6b0c989ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:55.501973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1fe49-e9bc-46a0-845d-f4a4f157dc08 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.516452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 311/620] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:26:55.520525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1522-5e02-4b7b-ba28-b68d6e487147 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.520804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1522-5e02-4b7b-ba28-b68d6e487147 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.521078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1522-5e02-4b7b-ba28-b68d6e487147 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.522705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 312/621] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:55.529548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.529881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.530162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.555214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:55.556263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.556460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:55.556929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.557203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.557472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.558431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:55.558770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:55.561108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:55.576686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 310/622] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:55.577984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.626959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 313/623] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:55.627875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.703431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195fdf-b0db-491f-843f-ec4137b68076 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.745670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.746504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.746785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.746964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4a080-8d6a-498a-b6cd-686ae81d3a61 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.747119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.757574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:55.769150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:55.771229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 311/624] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:55.773305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.787919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.789178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.789706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.789978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/cb0727d888284c15a4eb6fd7126f7d3e/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.808537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=cb0727d888284c15a4eb6fd7126f7d3e, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:55.810084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:55.826145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 314/625] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:26:55 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/cb0727d888284c15a4eb6fd7126f7d3e/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:26:55.827308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:55.889766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3d65-d633-43a9-b0b9-0e8746ef988e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.934621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee57391-7189-49d2-9c13-ece41b34df7a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:55.938455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.939288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.939628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.939899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.955892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-c21f5c44-3c86-4604-8b98-c47190c2b01b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:55.963911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:55.966124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 312/626] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:55.968404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bd6f-96ec-4f47-9155-e0e786cedfc4 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.969709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bd6f-96ec-4f47-9155-e0e786cedfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.969709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5bd6f-96ec-4f47-9155-e0e786cedfc4 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.969709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 313/627] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:55.974924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.975128 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.975693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.980919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:55.981602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:55.981877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:55.982144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:55.982900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:55.983199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:55.984640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:55.993949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 315/628] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:55.994671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.001755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:56.003169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:56.094186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 314/629] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:56.094186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.108540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c7df8-fcef-496f-8c40-4be5acf6053c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.144991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.145665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.145935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.146175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.146920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:56.147216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.148617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.158112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 316/630] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:56.163057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.200995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4573cd-216b-450d-833e-8b2078da00b8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.236538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.237728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.238205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.238670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.257950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed210f-7cc5-4db3-b088-602002c0162d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.261060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.262817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:56.281624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.282586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.283536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:56.283536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:56.283536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.283536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:56.285801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 315/631] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.286800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.296008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.296516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.296791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.297058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.307502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:56.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.316443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:56.317296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:56.321536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 317/632] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.322398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.391500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b5769-4dcd-4674-9f36-e41f4573ee90 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.419257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4bebe9-8d25-407c-8c5f-8b689794d200 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.426050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.427114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.427674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.428147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.438703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.440387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.452466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.453121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.453394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.453661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.454374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:56.454677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.456067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:56.460684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.461587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.462582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:56.462582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:56.462582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.462582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:56.469430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 316/634] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.470535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.472691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 318/634] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:56.473837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.570702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c538d-1725-4f05-80b4-287f8e6dea0f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.571078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be27cb6-5642-4360-bdb1-b901a3eeb149 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.606982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.607215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.607906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.608233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.608347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.608693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.608918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.609327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.609690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:56.610079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.610521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:56.610962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.611734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.612628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.621497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 317/635] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:56.622650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.632188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 319/636] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:56.632188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.727147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7b25-a2d5-4711-9555-0b25846d3345 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.732851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e7aa9-33cd-4926-8a9c-dfbe722178bd None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.759890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.760684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.760965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.761239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.768719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.768962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.769749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.770118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.770280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.770422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.780614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.782049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:56.783773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.785721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 318/637] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.788115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-ffbaf5f0-4f79-47ec-9fa7-fc468c15325d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:56.803705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.806022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.808970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:56.808970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:56.808970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:56.808970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:56.809480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 320/638] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.810744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22d029-ba9b-4c23-96db-8a167c8ce153 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.810994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22d029-ba9b-4c23-96db-8a167c8ce153 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.811285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22d029-ba9b-4c23-96db-8a167c8ce153 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.815428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 321/639] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:56.815428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22d029-ba9b-4c23-96db-8a167c8ce153 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.888431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b3592-fc47-46ee-af92-07b3e776d877 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.915806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22d029-ba9b-4c23-96db-8a167c8ce153 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:56.926800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.927847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.928374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.928744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.937870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.939903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.947981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:56.948657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.948938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.949246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.950088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:56.950396 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:56.951843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705ac87-ece2-4e13-834c-76e1aa2a3e32 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:56.955976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:56.956958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:56.957895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 319/640] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:56.959146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:56.978354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 322/641] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:56.978354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:56.978354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:56.978354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:56.993690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:56.994862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:57.071405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b43d1-e18b-43bf-b987-00a42aff0e28 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.071615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 323/642] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:57.071615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.106698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.107363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.107666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.107932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.108649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:57.108948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.110268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.121808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 320/643] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:57.124283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.172333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9828ad-b3fb-40d4-bbc9-bd234ba4534d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.207848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.208513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.208795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.209308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.209906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:57.210222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.211690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.220363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796914c1-3b2c-472b-9747-f0cbc2d855c2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.228419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 324/644] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:57.229398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.264076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.265497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.265784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.266051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.325604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc18fb-6489-432f-9f0f-f8021036603b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.333359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.335292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.359143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.359971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.360258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.360527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.370405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:57.378138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:57.379078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 325/645] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:57.380761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.443760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 321/646] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:57.444646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.480215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd4bd1-3970-4cca-821c-b6b866667bb7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.521055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.522004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.522286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.522596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.532248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.533646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.539077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82874e9-459c-406a-a83a-a9de63d4c8e6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:57.547525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:57.548446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:26:57.549381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:57.551688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 326/647] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:57.553343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.575817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.576468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.576751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.577030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.645409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.648209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.651022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075d6e92-9e49-4d92-887b-7ab5059daaad None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.683235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.684000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.684282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.684559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.685309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:57.685614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.686988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.699289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 327/648] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:57.699289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.749629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 322/649] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:57.750382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.796557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9906-e299-4549-b65d-93b4345c0084 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.828471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.829265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.829551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.829822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.840883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.842650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.849903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a47ae-bd6e-4fab-9718-e397b9ebdf9f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:57.859897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:57.860818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:57.861712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:57.861712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:57.861712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:57.861712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:57.861712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 328/650] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:57.862408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.884871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:57.885536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:57.885809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:57.886085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:57.886971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:57.887274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:57.888727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:57.906255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 323/651] 10.222.0.23 () {56 vars in 1137 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:57.907062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:57.966598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5ec32-2137-46c3-931e-2a558099ec11 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.001612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.002322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.002602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.002881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.007168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ac73-df4f-4e94-ac1e-05defde04ebd None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.014098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.015573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:58.032479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.033389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 329/652] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.039310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.042420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.043286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.043564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.043863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.054558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.056052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:58.072757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.073691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.074691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:58.074691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:58.074691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.074691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:58.074691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 324/653] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.074964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.136822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22288f83-e23a-4f2c-a5ef-e0697db7b5a6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.168547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.169201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.169475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.169743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.170467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.170763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.171750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e3e48-6133-4533-9830-deb0d08da6ac None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.172132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.183219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 330/654] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:58.184496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.204650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.205296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.205578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.205855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.269212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.270664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beed521-b2b4-49d5-896f-d54c755938ff None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.280045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ef967-e393-4152-a5a2-d2698d7f0515 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.312325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.313030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.313306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.313580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.314295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.314591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.315976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.326848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 331/655] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:58.327723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.364570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 325/656] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:58.365888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561346eb-6e9b-4aec-809f-76d4509461b2 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.366193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561346eb-6e9b-4aec-809f-76d4509461b2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.366451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561346eb-6e9b-4aec-809f-76d4509461b2 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.367739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 326/657] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:26:58.368418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561346eb-6e9b-4aec-809f-76d4509461b2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.423055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ca626-c748-496d-b261-7b1d4d9ce554 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.456537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.457190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.457472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.457739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.458454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.458758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.460152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.468505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561346eb-6e9b-4aec-809f-76d4509461b2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.472690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 332/658] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:58.473459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.500681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.501455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.501737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.502019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.508618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.509992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:58.523505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.524453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:58.525348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 327/659] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.526368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.571297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04a5be-68db-4cee-92aa-d19a8ce091d8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.604346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.605140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.605497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.605777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.612743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.614176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.619405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f115f9c-b539-47bf-87ce-846fd6aef4d2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-3ad5cce1-bfef-49b1-b51c-b63fc1b96953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:26:58.628377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.629368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:26:58.630306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 333/660] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.630906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.631132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.631339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.647630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:26:58.648780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:26:58.657302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.658090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.658365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.658630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.669166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.670612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:58.687745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.688661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.689531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:58.689531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:58.689531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:58.689531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:58.689531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 328/661] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.689812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.716666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 334/662] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:26:58.717825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.784927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7e1edb-3be1-4e41-ad99-1794edf31d70 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.812638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442ff28-808b-4751-8454-e99fae94d9c5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.816932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.817713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.817986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.818254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.824703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.826124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:58.839961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:58.840942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:58.841821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 329/663] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:58.842620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.851291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.851984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.852263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.852534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.853842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.854146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.855660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.866899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 335/664] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:58.867703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:58.942109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e5d-5119-4858-b0be-86a7e0d41b5c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.960978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70226a1-c288-47c5-b842-a1013958120b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:58.975815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.976465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.976747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.977022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.977858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.978167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.979601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.992916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:58.993559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:58.993832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:58.994101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:58.994812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:58.995112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:58.996134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 330/665] 10.222.0.23 () {56 vars in 1139 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:58.996523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:58.996947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.007974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 336/666] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.008779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.089856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed2430-4d01-4d2a-b30f-5d49e5a086d0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.104466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d478300-7573-4e60-9c50-fc378544591d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.124362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.125154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.125431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.125702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.135113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:26:59.142763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:59.143786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 331/667] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:26:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:59.144821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.147631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.148300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.148645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.149259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.150047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.150348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.151801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.163736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 337/668] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.164515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.246828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762431f5-af93-4ac9-b853-4c4f45546119 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.260112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f769e-5cef-47c3-99cc-e0678fc1bf35 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.280413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.281068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.281347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.281621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.282452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.282758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.284304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.289969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 332/669] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.290719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.291535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.292187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.292474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.292732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.369483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.371080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.398306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c53d7-1fc3-4a39-b709-f90ff36e3e1a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.434844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.435668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.435948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.436221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.443544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.444995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:26:59.460008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:59.461085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 333/670] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:59.467475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.475003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 338/671] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:26:59.475879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.571943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728256a0-0707-41ac-a679-998dd80fc711 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.574784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473f826-d586-4b9c-a7bc-8cd98508b0d0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.605887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.606704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.606833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.607186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.607401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.607667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.607761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.607962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.608709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.608800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=41e2d642d4db4a7f92fd6b45ebb5f8f9) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.609010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.609294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.610359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.610916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.622662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 339/672] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/role_assignments?user.id=41e2d642d4db4a7f92fd6b45ebb5f8f9&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.622662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.622936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 334/673] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.622936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.735016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1713f-10b3-44c8-9097-43caa5e2b2b8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.750891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8809-732a-4c23-8990-0d7066ce403e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.778843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.780273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.780556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.780830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.786988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.787836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.788216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.788588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.789494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.789928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.791527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.792988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.795004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.804917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 340/674] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.805606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:26:59.814654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:26:59.815773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:26:59.816928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:26:59.816928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:26:59.816928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:26:59.816928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:26:59.820446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 335/675] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:26:59.821294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:26:59.920233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b63588-cff7-4410-b782-847b3f6a2ce8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.933983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01cbd-d682-452f-877c-91ac8aabf8a2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:26:59.964523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.965384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.965809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.966082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.971213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:26:59.971971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:26:59.972313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:26:59.972653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:26:59.973556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=93f8c6e46f6d4cc8a3364bfa3e6b93d8) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:26:59.973931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.975449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.978907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:26:59.980710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:26:59.981719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 336/676] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/role_assignments?user.id=93f8c6e46f6d4cc8a3364bfa3e6b93d8&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:26:59.982562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:00.019422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:00.020409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:00.021301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:00.021301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:00.021301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:00.021301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:00.023178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 341/677] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:00.028897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.097020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e3f9a0-06e6-4e38-9574-481ad7168999 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.132324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.133204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.139407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.139407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.139407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:00.139407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.139407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.150896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 337/678] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:00.156448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.230939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be514f8-4534-401c-9b30-2e4ecb6d97f0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.269665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31086c62-59e7-48af-a294-fe91a450e6e2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.272105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.272775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.273052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.273324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.274053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:00.274354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.276853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.291157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 342/679] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:00.296069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.311163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.312028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.312301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.312568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.319404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.320955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:00.336557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:00.337461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:00.338345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 338/680] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:00.347400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.402661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4682fc0-0d37-4da9-8500-814b7ee12988 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.435787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.436594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.436867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.437135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.443274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96411bc-b7af-46e1-9081-7a1bc9613cda None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.444690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.446135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:00.461891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:00.464087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:00.466275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 343/681] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:00.472533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.490716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.491306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.491619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.491897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.492694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:00.493055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.494597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.508616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 339/682] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:00.518864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.570642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba767bc-3508-43ac-87e2-df1f5792fde5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.623023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.623743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.624024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.624300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.625153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:00.625462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.626912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.665211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 344/683] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:00.671031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:00.702945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e436ec0-c344-4c75-8cc1-37e1a55368e1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.768717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.769300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.769578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.769904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.770740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a3aa6a22bd7c49679c84f824f43aca30) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:00.771049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.772516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:00.785041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 340/684] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/role_assignments?user.id=a3aa6a22bd7c49679c84f824f43aca30&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:00.838953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e147aa9-c8f0-47c8-b858-19982a736e4a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:00.891370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:00.892063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:00.892346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:00.892621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:00.986540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:00.988047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:01.088648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 345/685] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:27:01.094610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:01.194225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d02c8-8fc1-4108-a710-9be7586a71b6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:01.227701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:01.228501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.228784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.229058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.240120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:01.241576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:01.262929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:01.263867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:01.264755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:01.264755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:01.264755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:01.264755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:01.264755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 341/686] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:01.269743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:01.414128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287fcfe-c563-4533-bee9-3863488e1c37 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:01.462649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:01.463695 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.464155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.464656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.465561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:01.466060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:01.467947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:01.485886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 346/687] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:01.491929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:01.625928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b8b92-b50d-4983-a2fc-b7593ae459a4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:01.668287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:01.669020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.669301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.669582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.676586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:01.678042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-76df1077-023d-4847-a7d6-2681060fa227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:01.697447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:01.698445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:01.699436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 342/688] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:01.704737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:01.839655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75edeae9-e6db-4031-b714-58986e42aa8d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:01.847746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23f46a-f8c0-45b5-b46a-048a89f17fdb None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.848237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23f46a-f8c0-45b5-b46a-048a89f17fdb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.848344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23f46a-f8c0-45b5-b46a-048a89f17fdb None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.849938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 343/689] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:01.855470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.855759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.856037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.876318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:01.877530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:01.886792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:01.892797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:01.905006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 347/690] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:01.911070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.006607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 344/691] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:27:02.042217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.054214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bcd029-93a8-42b2-8310-3af6660ceb30 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.097793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.098826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.099323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.099792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.100836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=cb0727d888284c15a4eb6fd7126f7d3e) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:02.101364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.103020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.117030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 348/692] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:01 2022] GET /identity/v3/role_assignments?user.id=cb0727d888284c15a4eb6fd7126f7d3e&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:02.197234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8f628-fdc8-4e84-bdbd-e70bf51b93dd None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.238974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.240185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.240639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.241069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.261732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-1c6c7914-3aff-422d-80d8-0875419ed166 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:02.269433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:02.270408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:02.271237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 345/693] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:02.276599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.375186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bd9-8d75-4f75-ae5e-7fecec1137f3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.375507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bd9-8d75-4f75-ae5e-7fecec1137f3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.375785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c005bd9-8d75-4f75-ae5e-7fecec1137f3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.378620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 346/694] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:02.384061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.384344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.384617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.403281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:02.404468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:02.411865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78596b7-6ee0-4f81-85a9-0df256edd127 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.447531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.448190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.448470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.448745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.449612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:02.449915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.451291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.460553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 349/695] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:02.466089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.483481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 347/696] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 04 21:27:02.508470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.600628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75403f9-2b50-4e43-b603-0f1c86a7581e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.615900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7503e-793d-46ee-9960-c19bbc2a44c5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.640585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.642170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.642897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.643410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.652952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.653750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.654028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.654296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.657771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.659654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.665229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.666687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:02.680605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:02.681531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:02.682436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:02.682436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:02.682436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:02.682436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:02.684740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 350/697] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:02.687686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:02.689506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:02.690765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:02.690765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:02.690765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:02.690765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:02.692579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.694253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 348/698] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:02.700171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.810545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c56783-8d85-4a45-92fd-0d7917d8ada4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.823812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450874a-258e-4f2a-b92d-830ff84adfe4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:02.872268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.873537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.875129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.875642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.877593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:02.878815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.880638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.894062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:02.895479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:02.895982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:02.896461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:02.897409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:02.897918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:02.899571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:02.908520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 351/699] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:02.914464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:02.927065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 349/700] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:02.933866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.024453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4add32-9bc0-4a70-84ca-5f9a746adfa7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.060289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.061608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.062390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.062982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.070849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.073098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e1a7c690-8eee-443e-a340-ab1efd5ffe51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:03.102703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:03.103821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:03.104859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:03.107481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 352/701] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:03.108918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55c2c-df3a-4f08-a393-ff1de280f3f9 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.113661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55c2c-df3a-4f08-a393-ff1de280f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.114198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55c2c-df3a-4f08-a393-ff1de280f3f9 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.116008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 353/702] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:03.116907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d55c2c-df3a-4f08-a393-ff1de280f3f9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.124735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52d3ff-ae87-492b-83b8-996279ee2651 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.160520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.161478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.161907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.162326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.163234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.164698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db8cb7-4f04-4aef-bae2-8abbf9a2e884 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.187964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 350/703] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:27:02 2022] POST /identity/v3/users => generated 254 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:27:03.189444 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.189734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.190095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.218442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:03.221941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:03.293605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d55c2c-df3a-4f08-a393-ff1de280f3f9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.370263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.372317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.374480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.375039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.377318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:03.378561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.380287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.393504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 351/704] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:03.402369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 354/705] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:03.408223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.421641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.531069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f5cd-a2ab-4e52-ab4b-54b02076a31f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.531494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de85c-c47f-4f77-ace7-9ada3ecdcb37 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.565772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.566961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.567496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.568063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.569109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.570996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.571990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.572649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.572930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.573203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:03.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:03.589178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:03.590639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:03.593908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 355/706] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:03.603983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.649698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.651206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f6520-a8fa-4264-be21-4166f5e9a51f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.711241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53645a2b-2600-4ce9-96b7-e21de22e3964 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.744374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.745041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.745313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.745586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.746382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:03.746684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.748097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420fa05-c179-413a-b8b0-5424bba47e39 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.752761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 356/707] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:03.753994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da981-33e7-472b-b4bc-64bdf3b4e2a1 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.754274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da981-33e7-472b-b4bc-64bdf3b4e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.754548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809da981-33e7-472b-b4bc-64bdf3b4e2a1 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.756018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 357/708] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:03.761497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809da981-33e7-472b-b4bc-64bdf3b4e2a1 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.769005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 352/709] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 04 21:27:03.770396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.770686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.771535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.794135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:03.795316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:03.866794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 353/710] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:03.868118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.885910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809da981-33e7-472b-b4bc-64bdf3b4e2a1 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:03.929664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:03.930258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:03.930538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:03.930811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:03.931699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:03.932007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:03.933727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:03.940894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 358/711] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:03.941833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:03.985769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bba22-b2b0-45ee-99e0-b619c1649c52 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.023335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.024592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.025118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.025584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.036176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.038009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:04.056990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:04.058049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:04.059023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:04.059023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:04.059023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:04.059023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:04.061348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 354/712] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:04.064120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ecd75-e1ad-4353-88fa-8223e8419da5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.067493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.107068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.107900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.108175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.108452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.109106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.110470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:04.127537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:04.128627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:04.129466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 359/713] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:03 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:04.134946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.179532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443f9ca-5958-4b77-8583-7f0da11d7525 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.215579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.216600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.217451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.217945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.219113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:04.219705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.221373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.234518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 355/714] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:04.240385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.280676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0937d-1d62-4889-bae9-9e371d62ecc1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.322713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.323458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.323919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.324106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.324791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] RBAC: Adding query filter params (name=network) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:04.325742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.326465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.338229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 360/715] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:04.345421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.453491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcf261-9d21-482b-99c8-bd8ae15bbed1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.459399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd1b7a-946e-4c86-a735-9eec478f5558 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.504861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.505432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.505709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.506028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.506745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] RBAC: Adding query filter params (type=network) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:04.507047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.508464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.514057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.515140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.515664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.516137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.519847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 361/716] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:04.523783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.525528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:04.541303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:04.542276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:04.543269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:04.546034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 356/717] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:04.551580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.741100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b743a69-9583-411a-92b2-03d2663bf7ff None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.773711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.774715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.775196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.775687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.776679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:04.777237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.778886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b6664f-4f74-441d-9bcc-37100f8bc7be None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.795051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 362/718] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:04.802152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:04.906160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77709598-37f5-4ddf-bfc1-d207d4f2d6b5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:04.940099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:04.941216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.941699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.942243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.943280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:04.943842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:04.945472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0a860-64a9-4452-bb2f-ba183699f353 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:04.952622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 357/719] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:04 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:04.993766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2e4-76d6-44a7-b190-60b82eda5f0d None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:04.994477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2e4-76d6-44a7-b190-60b82eda5f0d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:04.994987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c2e4-76d6-44a7-b190-60b82eda5f0d None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:04.997055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 363/720] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:05.002712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:05.003223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:05.003300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:05.027922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:05.029024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:05.109016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 358/721] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:05.152178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c2e4-76d6-44a7-b190-60b82eda5f0d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:05.293507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c2e4-76d6-44a7-b190-60b82eda5f0d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:05.345917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:05.347101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:05.347601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:05.348069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:05.368332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:05.376328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:05.377303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:05.378261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:05.380995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 364/722] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:05.388720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:05.497721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5cc37a-e6a1-4f95-8c09-9552ffcbbe56 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:05.536643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:05.537666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:05.538141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:05.538608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:05.539623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:05.540121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:05.541668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:05.554990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 359/723] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:05.560389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:05.669189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f10922-8a0b-4cf0-b10e-5776ad8e4446 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:05.707010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:05.707838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:05.708114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:05.708383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:05.719528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:05.721007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:05.748568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:05.749559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:05.750470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:05.750470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:05.750470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:05.750470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:05.750470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 365/724] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:05.755658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:05.905282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6adb8c-7035-47d5-b914-137afb69add1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:05.949030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:05.949709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:05.949983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:05.950248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:05.950971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:05.951270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:05.952724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:05.970950 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 360/725] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:05.976393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.091771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8873bb-1c01-4d15-9e21-0e5e7464e4d9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.131048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.131916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.132193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.132465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.143973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:06.145383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-59ed7aaf-4af7-4b58-8aca-e09a526fec7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:06.162374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:06.163356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:06.164348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:06.166901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 366/726] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:06.176498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.316571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8471f-91d8-4500-b2de-8a472b10b577 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.349092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.349763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.350092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.350361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.351236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:06.351570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:06.352977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:06.359138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec89c-3d39-418e-a85a-2371d0e26473 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.359727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec89c-3d39-418e-a85a-2371d0e26473 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.360200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec89c-3d39-418e-a85a-2371d0e26473 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.362033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 367/727] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:06.367445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.367949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.368419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.382947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 361/728] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:06.385603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:06.387096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:06.388449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.474307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 368/729] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:06.513180 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.551078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817b06e-1f93-4018-9a5a-15a20e9e14f4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.586723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.587797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.588275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.588760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.656156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:06.656355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8da424-1a36-4a7d-b58e-b7fabdd1a057 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.658413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614a6ef-ad0c-4518-8f2e-1ca8dcfc0aa5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:06.704232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.705390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.705390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.705657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.722771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:06.739443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:06.740447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:06.741276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 369/730] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:06.747038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.774746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 362/731] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 04 21:27:06.776496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6efe53-651a-4bf7-9485-3619a5535643 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.777036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6efe53-651a-4bf7-9485-3619a5535643 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.777546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6efe53-651a-4bf7-9485-3619a5535643 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.779278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 363/732] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:06.780622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6efe53-651a-4bf7-9485-3619a5535643 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.881718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d01a1-e0a2-4405-b86b-e1f80306a449 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.887027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6efe53-651a-4bf7-9485-3619a5535643 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:06.921593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.922505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.922864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.923200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.923852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:06.924870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.925326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.925763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.926885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:06.927364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:06.929315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77d41a-50f4-4fa2-8b7f-6985931df2aa None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:06.936237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:06.937573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:06.940552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 370/733] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:06.942072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:06.942559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:06.943004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:06.956789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:06.957721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:06.958595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:06.958595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:06.958595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:06.958595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:06.962805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 364/734] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:06.963734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:06.965111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:06.966649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:07.054884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 371/735] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:07.056080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.082008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f469db-a41d-4de8-bc30-3ceb86199039 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.121641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.122416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.122692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.122968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.134849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.136469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:07.153928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:07.154864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:07.155763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:07.155763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:07.155763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:07.155763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:07.155763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 365/736] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:07.156324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.173894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b88e3-057c-495e-b462-e54f900e69d6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.216658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.217995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.218427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.218702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.219628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:07.219934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.221784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.233818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 372/737] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:07.235021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.269184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecc879-0b7b-419d-83c7-9850cce1777c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.303983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.304659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.305006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.305304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.305937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.307301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95d447-165f-466b-9a18-6e1fd47f7037 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.325126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 366/738] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:07 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:07.327099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91dcb3-f978-4881-898d-b54a799eb83f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.327652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91dcb3-f978-4881-898d-b54a799eb83f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.328300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91dcb3-f978-4881-898d-b54a799eb83f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.330957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 367/739] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:07.332058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91dcb3-f978-4881-898d-b54a799eb83f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.364523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad6e74-453a-45d2-9d0d-eee1ff099122 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.419486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.420174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.420450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.420720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.421642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:07.421934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.424108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2cc2e-17c8-4131-86cf-f49b4f929c4e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.443574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 373/740] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:07.445338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.445865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.448385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.472487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:07.474817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:07.483241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91dcb3-f978-4881-898d-b54a799eb83f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.518672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.520513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.520513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.520513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.528513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.530072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:07.545723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:07.546666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:07.547588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 368/741] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:07.551915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.560130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 374/742] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 04 21:27:07.561753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.663799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92071e88-d220-4ff5-aadb-03298138b9ba None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.681098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226c90-0888-4370-a4b0-52994db6f4d2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.699915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.700758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.701137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.701499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.702414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:07.702817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.704401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.717843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 375/743] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:07.718822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.727655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.728977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.729503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.730672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.740584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.742768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:07.762467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:07.763574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:07.764514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:07.767436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 369/744] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:07.768376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.836134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422eadb-2e7f-4d51-ae5d-b6971cd0594b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.874467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0a431-e933-4e1a-b816-ed071ee0ca95 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:07.878860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.879564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.879849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.880126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.880844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.882250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.903419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 376/745] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:07 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:07.903419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:07.932366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:07.933778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.934233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.934917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.935951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=cb0727d888284c15a4eb6fd7126f7d3e) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:07.936557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:07.938826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3857-0de5-4a13-815c-f04f20154588 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:07.947033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 370/746] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/role_assignments?user.id=cb0727d888284c15a4eb6fd7126f7d3e&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:07.949252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453072-e0e6-4fb3-93a1-12d8883803f5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.949705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453072-e0e6-4fb3-93a1-12d8883803f5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.950116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453072-e0e6-4fb3-93a1-12d8883803f5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.952718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 371/747] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:07.958789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:07.959492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:07.959907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:07.983997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:07.985601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:08.025397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea53565-4cbf-402f-81c9-cd14dc829a3f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.061673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 372/748] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:08.072592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.073284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.073611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.073899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.074851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:08.075162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:08.076789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:08.097485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 377/749] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:08.103237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.112433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.225458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e43fe-8f14-4589-ad4b-de47b828ad55 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.249174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac21641-4e6e-4c6e-b274-8921c95cd696 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.281122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.281923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.282199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.282469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.299991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.301379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.301652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.301922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.308060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:08.318928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:08.319936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:08.320814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 373/750] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:08.327897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.420849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:08.422243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:08.510689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69687ccd-6f15-46c8-86cb-a3c763666142 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.578560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.579233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.579659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.579937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.580691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:08.580995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:08.582361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:08.588929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 378/751] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:08.598889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.599898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 374/752] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:08.606022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.710891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4178da0-bdfc-4959-bb9d-a56a76ad866f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.750177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.751007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.751282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.751575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.763247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:08.765430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:08.788837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:08.791020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:08.793220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:08.793220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:08.793220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:08.793220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:08.795660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 379/753] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:08.800504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:08.926602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2733df-f8ce-47c9-b7f0-77ab51231fb9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.929818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187e3a-54e9-4a1c-a187-3afe1d700a49 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:08.960085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:08.960776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:08.961108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:08.961326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:08.962104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:08.962406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:08.963792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:08.979494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 380/754] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:08.981293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.016879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.017692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.017975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.018249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.041428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.042959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.079057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99ed3d-e60e-47ca-a6da-88b0b293d1a7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:09.087741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:09.088730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:09.089682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:09.089682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:09.089682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:09.089682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:09.089682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 375/755] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 483 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:09.096270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.112835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.113638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.113906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.114173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.121164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.122610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:09.136750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:09.137637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:09.138529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:09.147403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 381/756] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:09.147403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.282423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061388f5-4a58-4fab-a261-dfbc6703c854 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.290517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8be5ae-d6bf-40d2-b373-f4336ea1eea5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.344435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.345102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.345375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.345643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.346368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:09.346665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.348059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.363047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.363744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.364021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.364285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.365077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:09.365376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.366932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.373901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 376/757] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:09.379624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.383854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 382/758] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:09.385507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.485690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97388dad-8b19-4321-94a5-a67f7183e754 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.518030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.518610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.518934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.519209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.520119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=907472893cec4b2ab7ee51b10aa1a214) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:09.520429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.521862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.531523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 383/759] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/role_assignments?user.id=907472893cec4b2ab7ee51b10aa1a214&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:09.614700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630a0c1-66a2-4158-96b0-b43c49063af9 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.666913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.667793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.668084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.668361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.680319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.681762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:09.699807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:09.700809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:09.701745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 377/760] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:09.708628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.827868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24867af-1b2c-47c7-8b5a-f28a3a737820 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:09.869475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:09.870158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.870465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.870738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.871609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:09.871914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:09.873345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b4295-b466-4f90-8c58-c9ca140915b2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:09.892701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 384/761] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:09.898233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:09.957257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690e6d-084c-4a9b-81bb-2011fd07e36f None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.957575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690e6d-084c-4a9b-81bb-2011fd07e36f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.957804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d690e6d-084c-4a9b-81bb-2011fd07e36f None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.963356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 385/762] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:09.964926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:09.965279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:09.965619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:09.987638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:09.989889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:10.074027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543ab29-7b18-4384-a7bd-92fe0042c4ec None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.103277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 386/763] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:10.130380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.131213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.131519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.131846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.142473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.144010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.155709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:10.172248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:10.173157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:10.174046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:10.174046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:10.174046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:10.174046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:10.174696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 378/764] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:10.180571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.323691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf13ac4-5091-44d6-8998-53e4dc48f6d0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.357135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.357877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.358151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.358421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.359067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.360455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:10.373788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:10.374842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:10.375700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 387/765] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:10.382939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.384641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f9b5f-0872-4080-93d7-a32d57926120 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.458772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.460089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.460593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.461062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.461995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:10.462494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.464171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.493209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 379/766] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:10.517699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.574415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd180ad-30fd-45e1-a365-ea800c88b0d1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.623963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.624761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.624873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.625089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.625898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:10.626110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.627537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eea42c-f384-461f-88fc-59d2df7d42b9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.631246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f8c80-09ad-4e96-808a-ccda450ad01f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.632364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 388/767] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:10.638071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e921b6-7695-467a-b9ed-d7923e914f7f None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.638071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e921b6-7695-467a-b9ed-d7923e914f7f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.638071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e921b6-7695-467a-b9ed-d7923e914f7f None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.639771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 389/768] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:10.641208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c83e3-3862-415f-8a58-fef007abf89f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.641499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c83e3-3862-415f-8a58-fef007abf89f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.641778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26c83e3-3862-415f-8a58-fef007abf89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.658145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f26c83e3-3862-415f-8a58-fef007abf89f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:10.659318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f26c83e3-3862-415f-8a58-fef007abf89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:10.672351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.673496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.673973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.674455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.681557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.683056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:10.696263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:10.697174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:10.698087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:10.703069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 380/769] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:10.703069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.726868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 390/770] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:10.728210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a62b-cc5a-4e37-a2d5-f0b8d1661d82 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.728561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a62b-cc5a-4e37-a2d5-f0b8d1661d82 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.728928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc39a62b-cc5a-4e37-a2d5-f0b8d1661d82 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.734250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 391/771] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:10.734250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a62b-cc5a-4e37-a2d5-f0b8d1661d82 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.807917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97df8bc-34a2-4b8b-9817-188916b3e775 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:10.844113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:10.844802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.845084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.845360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.846111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:10.846419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:10.847857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1569e9-a397-4753-84a5-8e913efe4ff5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:10.854707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 381/772] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:10.856080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:10.856369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:10.856652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:10.876205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:10.877531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:10.950717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 382/773] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:10.951492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:10.993256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc39a62b-cc5a-4e37-a2d5-f0b8d1661d82 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.031078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.031750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.032031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.032307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.033101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.033407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.034827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.050886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 392/774] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:11.050886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.054280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60608a9-945f-4891-9c44-9c988e5863d0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.088927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.089734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.090015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.090291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.100517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:11.108279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:11.109206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:11.110067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 383/775] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:11.110785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.146615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8984d6-e641-4627-9f85-87880e406535 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.181059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.181725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.182003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.182272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.183155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] RBAC: Adding query filter params (interface=public, service_id=e221489254934e8ea11523d920e46b11, region_id=RegionOne) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.183500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.184861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.192672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 393/776] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/endpoints?service_id=e221489254934e8ea11523d920e46b11&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:11.193411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.214932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c4ac1-1eb0-4df7-aa1e-dcc901bd1141 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.248272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.249074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.249352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.249645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.250279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.253858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:11.265628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:11.266664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:11.267550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 384/777] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:11.268345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.303144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e2bd-65c0-42f6-9563-0ef51df1e432 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.335552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.336433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.336709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.336980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.338958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=0916e52c6c48499588ca68d970588ee7, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.340455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.354590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 394/778] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:11 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:27:11.355460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.366300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639f69-1609-42b5-ae12-474f9bd49bf5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.402549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.404040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.404533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.404996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.405976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.406476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.408088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.417521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 385/779] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:11.418912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.477460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ff90d-012a-408c-8bbc-22ceebdabf6e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.513947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.514674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.514956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.515225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.515992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.517452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.523553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 395/780] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:11.524237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.529887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841da9b-47c2-43fe-a27c-fed3c9160469 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.567586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.568679 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.569154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.569618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.570535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] RBAC: Adding query filter params (name=network) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.571073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.572746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.578643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 386/781] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:11.585398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.695635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53545649-d5c0-418f-ad15-2845014c060f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.728552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4117e8-a7e3-443c-8fce-19384cb8f89f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.740435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.741236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.741513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.742296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.768473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.769933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.795776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.796445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.796729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.797001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:11.799489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:11.800358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:11.801270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:11.801270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:11.801270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:11.801270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:11.801494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] RBAC: Adding query filter params (type=network) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.801494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.802035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:11.804826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 396/782] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:11.809747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 387/783] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:11.811546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.814953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:11.926791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac3b37-9b9c-42fc-b45a-036e4d499178 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:11.973851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:11.974448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:11.974729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:11.975004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:11.975860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] RBAC: Adding query filter params (interface=public, service_id=2e3179b216b9458cad4ea22ac13cba55, region_id=RegionOne) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:11.976174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:11.977578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.001537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 388/784] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/endpoints?service_id=2e3179b216b9458cad4ea22ac13cba55&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:12.004687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.046503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b502-eb2e-404e-bcb2-e05c7465cf8b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.107646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.108317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.108598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.108870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.109604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:12.109907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.111282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfee756-6cfb-49a3-8fbc-309c78107bff None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.137766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 397/785] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:12.139107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf817-789a-4401-8455-6430b76ba3a4 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.139403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf817-789a-4401-8455-6430b76ba3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.139673 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf817-789a-4401-8455-6430b76ba3a4 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.146423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 398/786] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:12.148454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf817-789a-4401-8455-6430b76ba3a4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.171791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57219af2-1e45-4102-80a4-795e0491258c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.212149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.213246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.213658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.213937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.214665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.216267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da21a9-558c-4640-80e8-f78ede920cde None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.223621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 389/787] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:12.224961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.225193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.225932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.249402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:12.249402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:12.254598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bf817-789a-4401-8455-6430b76ba3a4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.309079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.309896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.310170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.310969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.328470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.330165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:12.354337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:12.355480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:12.356481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 399/788] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:12.364512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 390/789] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:12.365607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.428623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.512263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3821a020-d07d-4050-a7f8-1ea570a19ac8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.549476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.550403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.550682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.550950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.551823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:12.552127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.553715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.577641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4266ee-913e-4f51-b726-63e0a66ac41c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.582175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 400/790] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:12.592652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.668123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.668943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.669222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.669492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.696195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0d7f1-8ccb-434d-be56-151c77090dd3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.700346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:12.708197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:12.709159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:12.709995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:12.715821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 391/791] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:12.721775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.734844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.736029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.736507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.736972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.747534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.749289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:12.768025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:12.768929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:12.769815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:12.769815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:12.769815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:12.769815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:12.772052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 401/792] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:12.783478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:12.912417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646459f-825f-485e-a6a0-10925ce0534f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.953404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63d3238-a994-44e5-abbd-e4a348a0beb4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:12.978729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:12.979807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:12.981380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:12.981855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:12.983635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:12.985277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:12.986842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.002406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 392/793] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:13.004805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.005705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.006177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.006654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.007607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:13.008105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.008209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.009841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.021797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 402/794] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:13.028293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.170807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c98f5-7942-4a07-96fb-1dd9087acd63 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.205536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe45e-1bc2-45db-9206-4af5704a09f9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.221736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.223091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.223581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.224016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.236120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.237787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:13.257418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:13.258302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:13.259200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:13.259200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:13.259200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:13.259200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:13.261391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 393/795] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:13.273698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.288480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.289523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.289802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.290149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.301241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.303424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:13.321063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:13.322012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:13.322915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 403/796] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:13.331992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.399057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4082f6-1664-478e-974f-dd2ac354049b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.453043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.454630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.455112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.455617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.456554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:13.457074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.458647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.477908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a10661-7511-4c52-b3e5-0ce8acbad576 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.486781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 394/797] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:13.508930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.532340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.532959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.533288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.533560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.534402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:13.534750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.537068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.561732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 404/798] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:13.567500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.658886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565ab61-fecf-46db-9d10-489691c60fbc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.721507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.722363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.722600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.722866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.726599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1a96-1948-4170-9087-9c494be7b069 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.735046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.736799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.761641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.762929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.763433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.763963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/cb0727d888284c15a4eb6fd7126f7d3e/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.766257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=cb0727d888284c15a4eb6fd7126f7d3e, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:13.766560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:13.767513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:13.768491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 395/799] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:13.771015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.773725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:13.791067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 405/800] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:13 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/cb0727d888284c15a4eb6fd7126f7d3e/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:27:13.917643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d321134-879c-417f-bb9a-78a2fb65eaba None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:13.957216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:13.958286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:13.958875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:13.959353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:13.960556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:13.961085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:13.962765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c1ea-66eb-4c80-b715-60d1c0071f39 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:13.987190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 396/801] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:13.995724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.112871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed5a68-d8d4-476f-9d13-ce0ace703627 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.155961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.157193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.157672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.158140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.162897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078412-0c62-47cc-bb00-7568a4d7174a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.163179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078412-0c62-47cc-bb00-7568a4d7174a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.163473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3078412-0c62-47cc-bb00-7568a4d7174a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.166187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 397/802] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:14.170273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215a59-4c7e-4d6c-9141-10e8ea311f41 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.170559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215a59-4c7e-4d6c-9141-10e8ea311f41 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.170829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42215a59-4c7e-4d6c-9141-10e8ea311f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.173058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.174755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:14.198844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:14.199822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:14.200720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:14.200720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:14.200720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:14.200720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:14.203000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 406/803] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:14.208478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.212639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-42215a59-4c7e-4d6c-9141-10e8ea311f41 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:14.214520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-42215a59-4c7e-4d6c-9141-10e8ea311f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:14.294775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 398/804] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:14.296801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b866f-df39-4089-b1a1-c19e30ab8add None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.297228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b866f-df39-4089-b1a1-c19e30ab8add None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.297636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b866f-df39-4089-b1a1-c19e30ab8add None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.299571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 399/805] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:14.304576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.305046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.305511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.322480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:14.323099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8a59e-41f1-48de-8417-ce68dfbf9819 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.324240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:14.357459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.358124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.358407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.358683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.359424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:14.359735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.361125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.373586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 407/806] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:14.374326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.393421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 400/807] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:14.394536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.494314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304c202-b592-4244-a47b-504bdb2af9db None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.512315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25b25-8e20-4d88-b563-3d75dc44afc1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.533270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.534127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.534408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.534679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.535331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.536721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:14.550318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:14.551276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:14.552140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 408/808] 10.222.0.23 () {56 vars in 1129 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:14.552971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.560522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.562103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.562581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.563044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.572297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.574080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:14.592733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:14.593631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:14.594521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:14.597584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 401/809] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:14.598847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.670109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e26c71-dca6-4dd0-92a6-28a2265cfd53 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.703977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1748-f5c2-47e4-af30-e68fb0e58428 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.715592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.716427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.717082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.717360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.728055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:14.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:14.736919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:14.737747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:14.742320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 409/810] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:14.743172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.743934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.744835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.745368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.745829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.746915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:14.748287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.749893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.756161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 402/811] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:14.757474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.853527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfa221-b38e-4170-a9ba-f50a4e913891 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.876661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34512-0dd3-40da-aae9-22ce9990c0a4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:14.888749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.889521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.889708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.889937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.890722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:14.891025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.892633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.906519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 410/812] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:14.907417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:14.926620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:14.926978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.927244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.927538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.928305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:14.928610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:14.930031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b523713-41f8-4140-8f3d-7ad2d9c80f25 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:14.938586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 403/813] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:14.940069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abad96-10f4-4c9d-94c8-781f34c7f04a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:14.940350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abad96-10f4-4c9d-94c8-781f34c7f04a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:14.940618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abad96-10f4-4c9d-94c8-781f34c7f04a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:14.941976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 404/814] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:14.942681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abad96-10f4-4c9d-94c8-781f34c7f04a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.021362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d790fc-f3ef-42d9-a29e-e72889e74fb2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.054778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abad96-10f4-4c9d-94c8-781f34c7f04a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.055826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.056491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.056768 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.057025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.057783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:15.058099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.059488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.068973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 411/815] 10.222.0.23 () {56 vars in 1124 bytes} [Wed May 4 21:27:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:15.068973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.097053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.098438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.098789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.099074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/907472893cec4b2ab7ee51b10aa1a214/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.113883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=907472893cec4b2ab7ee51b10aa1a214, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.115327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506133e8-e268-41c1-9a80-f7a29c99f7a6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.139424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 405/816] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:14 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/907472893cec4b2ab7ee51b10aa1a214/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:27:15.139424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.139424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.139424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.148507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:15.149763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:15.192696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fafb00-1e0e-46f5-a2bf-cf356ee4b527 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.231674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.234549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.234549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.234549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.234800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 406/817] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:15.235391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.261113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.262069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:15.286709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:15.287696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:15.288613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:15.288613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:15.288613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:15.288613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:15.288613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 412/818] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:15.289327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.350840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2845064-0fd3-4e7f-840b-0ab66981181d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.384583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.385241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.385527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.385862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.386600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.388006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.393598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ceee3-c89b-4cd2-913e-256e738f3c2e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.413381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 407/819] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:15.414567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.438263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.439126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.439423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.439779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.440544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.442106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:15.455664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:15.456715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:15.457553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 413/820] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:15.463540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.529609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40809a6f-d15a-4aab-87f1-9391db7c1c34 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.565005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.565729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.566002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.566270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.566834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10ae45-fb6d-4f4e-b1dc-b6bd3bd1eaa6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.567049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:15.567333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.568747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.582915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 408/821] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:15.590156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.609611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.610702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.611177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.611669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.612572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] RBAC: Adding query filter params (name=network) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:15.613069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.614660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.620401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 414/822] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:15.628788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.703781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1a3f6-f81c-483c-a817-ce69e1ce217d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.737230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.737944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.738272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.738822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.746073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.747534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:15.762818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:15.763859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:15.764831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:15.767434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac7b7d-94ec-4add-9250-9318f9c67ec5 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.768708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 409/823] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:15.769879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.803035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.804090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.804567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.805057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.805954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] RBAC: Adding query filter params (type=network) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:15.806468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.808115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.813676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 415/824] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:15.819116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.873523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f6d5a-2825-4e55-b5f0-355e85901992 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.908052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.908745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.909098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.909369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.910253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:15.910560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.912011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:15.933353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 410/825] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:15.938201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:15.944177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7573acf2-b790-436a-be04-233e77b1077d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:15.986211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:15.987482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:15.988307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:15.989044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:15.990132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:15.992063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.018512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 416/826] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:16.049281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa618e7f-14d4-4364-8467-e6437ac82c19 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.092897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.093549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.093824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.094089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.184533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:16.186041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb72e44-767c-49ea-93ad-170e35986afd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.325515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 411/827] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:16.331434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.436097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1b8f-4da9-4dd2-be53-5da137592098 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.436484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1b8f-4da9-4dd2-be53-5da137592098 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.436650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313b1b8f-4da9-4dd2-be53-5da137592098 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.438163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 412/828] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:16.448387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.448668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.448967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.449909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd45e6-fada-46a2-bffc-1f8d195e0fa4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.474765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:16.476604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:16.486468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.487279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.487586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.487856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.504851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:16.507287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:16.533906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:16.534873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:16.535796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:16.535796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:16.535796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:16.535796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:16.537039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 417/829] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:16.544374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.569866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 413/830] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:16.593230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.655835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500615d0-945a-4eed-ba51-d7e78b2e7b6d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.688402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.688603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306e318-62d7-4ff4-b731-8b97224b3a35 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.689539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.690017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.690581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.691538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:16.692037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:16.693602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.705717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 418/831] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:16.712239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.731219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.732059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.732340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.732621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.746326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:16.756254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:16.757206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:16.758117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 414/832] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:16.763614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.843005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af22ba1-9191-49f2-a36f-451c1c061723 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.861326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9278e-c679-4f71-ae0c-394386c898e4 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:16.890018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.891057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.891488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.891922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.895361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:16.896244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:16.896589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:16.896931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:16.897753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:16.898125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:16.899580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.900727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:16.902365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:16.908667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 415/833] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:16.913874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:16.916895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:16.917775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:16.918651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:16.921070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 419/834] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:16.926317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.015839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52601444-4b37-468d-a2bb-3e1bc269e061 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.024127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791346-d7cb-458b-9fb0-71ab84f36f30 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.048860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.049493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.049836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.050336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.060984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.062033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.062141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.062597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.063072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.063536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.064480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:17.064974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.066569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.079458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 420/835] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:17.080962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:17.081789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:17.082681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:17.082681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:17.082681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:17.082681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:17.088110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 416/836] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:17.089102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.089530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.189552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c055b99-9290-49af-8b8b-f67640021907 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.203220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd902e-0bb1-41ba-a5e1-67d0f876ab88 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.229754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.230688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.230970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.231244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.231997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:17.232313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.234387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.248883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.249907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.253515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 421/837] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:17.253515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.256377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.256904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.257962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:17.258482 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.260199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.267570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 417/838] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:17.361235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b8b00-143c-4c81-94c7-34cc99e10283 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.396928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.397740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.398019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.398292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.406791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.408278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:17.423523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:17.424541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:17.425466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 422/839] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:17.432639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.536484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745c94-e8a9-413a-8181-18dc00bfc383 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.572294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.573111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.573356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.573632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.574538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:17.574844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.576344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e345-e697-4011-87b9-8c842ce8c6ed None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.594184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 418/840] 10.222.0.23 () {56 vars in 1135 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:17.599785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.699164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5305a1-2e40-4786-a68c-62e543a9857a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.717442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29c1c-798e-483d-bc2b-2637897dc5b8 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.718351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29c1c-798e-483d-bc2b-2637897dc5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.718857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a29c1c-798e-483d-bc2b-2637897dc5b8 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.720648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 419/841] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:17.728407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.728896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.729187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.738753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.739429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.739710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.739983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.746339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:17.747566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:17.822603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:17.823015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 420/842] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:17.824157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:17.841398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.929663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 423/843] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:17.935242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:17.937119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0509e-9ba1-46b6-af5f-e4062677155d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:17.970463 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:17.971307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:17.971658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:17.971935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:17.982130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:17.989978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:17.992160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:27:17.994085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:17.999431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 421/844] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:18.000885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.034156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43fb21-4b64-4479-b163-e5652d7f4bf7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.068890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.069686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.069956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.070229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.080816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.081898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:18.099999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:18.101142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:18.102203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:18.102203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:18.102203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:18.102203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.106076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 424/845] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:18.107107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.109905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a3b0-f027-46bf-8fa7-6f757aaae02a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.143366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.144351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.144793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.145206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.146106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.146548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.148097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.161370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 422/846] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:27:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:18.162530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.211951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e516828-61c5-4aec-a8a9-fb76af205427 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.249803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.250468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.250750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.251017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.254280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.254280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.254280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420996ec-1e7c-49b5-bc5a-6f3926747e0d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.265066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 425/847] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:18.266176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00ea5-a889-4b93-bdbb-ef9de9996cfb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.266458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00ea5-a889-4b93-bdbb-ef9de9996cfb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.266728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb00ea5-a889-4b93-bdbb-ef9de9996cfb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.267777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99137cee-07b4-4935-aea6-b1dbe55b11b3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.271491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 426/848] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:18.271491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb00ea5-a889-4b93-bdbb-ef9de9996cfb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.303795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.304588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.304872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.305136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.315253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.316756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b15bd2cc-1826-4b1c-a522-d9edcba32772 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:18.333738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:18.334767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:18.335714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:18.335714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:18.335714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:18.335714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:18.335714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 423/849] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:18.336495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.336778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.337049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.353433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:18.354718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:18.375344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb00ea5-a889-4b93-bdbb-ef9de9996cfb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.412977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.414259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.414804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.415583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.421979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 424/850] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:18.422820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.434562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.436919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:18.456072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:18.457269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:18.458372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.465113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 427/851] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:18.466268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.520140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751926bc-ae6f-477c-bdf2-ded913b73218 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.556250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.556915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.557194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.557537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.558247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.558548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.559959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.565503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e601ad19-5bbc-4205-8659-4c7c501edb3c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.570651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 425/852] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:18.571442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.603784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.605027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.605466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.605870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.606650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.608170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:18.619612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:18.620819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:18.621834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.624274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 428/853] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:18.625171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.674431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d35ec0-cb63-4d6a-8de7-4a707db27ad7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.707228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.707909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.708191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.708461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.709251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.709555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.710974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.728113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 426/854] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:18.728275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaef38-63f1-4cb8-ba36-f1490319187b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.728392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.759228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.760079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.760365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.760686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.767947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.769377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:18.783407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:18.784541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 429/855] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:18.785465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.827359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae85dc94-2563-4d04-bb9b-0e5d634beb92 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.861457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362945f-4fde-4bda-b381-129189518233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362945f-4fde-4bda-b381-129189518233 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.862282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362945f-4fde-4bda-b381-129189518233 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.862553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362945f-4fde-4bda-b381-129189518233 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.863269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362945f-4fde-4bda-b381-129189518233 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.863583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362945f-4fde-4bda-b381-129189518233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.864952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362945f-4fde-4bda-b381-129189518233 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.869238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 427/856] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:18.870096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362945f-4fde-4bda-b381-129189518233 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.892099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e93e-7255-46fa-b649-25531dec5030 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:18.927023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:18.927704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:18.927975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:18.928239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:18.929051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=cb0727d888284c15a4eb6fd7126f7d3e) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:18.929358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:18.930778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:18.944517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 430/857] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/role_assignments?user.id=cb0727d888284c15a4eb6fd7126f7d3e&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:18.944517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:18.994454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362945f-4fde-4bda-b381-129189518233 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.041723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.042472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.042794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.042920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a0f5e3-0145-49ee-b7fd-815d9b34862c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.043062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.043955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:19.044262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.047185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.072916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 428/858] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:19.079201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.087711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.088747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.089206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.090258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.091206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:19.092033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.094384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.101319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 431/859] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:19.195777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c302ddb-2a9c-4ba1-9d2a-7c555f1914e1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.234078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.234739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.235011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.235289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.318104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.319589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.418115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 429/860] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:19.423969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.524159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033083c1-0247-4003-ad31-00deb9a83e85 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.556888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.557741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.558022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.558291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.568880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.570320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6fafdbbf-74ab-4d9e-a055-d8e2aae5e391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:19.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:19.587915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:19.589285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:19.589285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:19.589285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:19.589285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:19.589285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 432/861] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:19.594271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.596844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81083-653d-4242-9119-b318d1d00e6a None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.597128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81083-653d-4242-9119-b318d1d00e6a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.597398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b81083-653d-4242-9119-b318d1d00e6a None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.598940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 433/862] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:19.603640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.603919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.604217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.620499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:19.621647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:19.692596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 434/863] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:19.701160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dde84e-b250-40e4-a608-203717a9c89a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.714981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.747021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.748255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.749473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.749942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.750852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:19.751346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.752919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.766992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 430/864] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:19.772590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.817531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf1bd3d-dd65-40f1-8752-a4cc89210523 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.852275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.853187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.853533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.853869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.854716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.856491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:19.868818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:19.869782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:19.870656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:19.875299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 435/865] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:19.876225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.891651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c07c6-9c72-49c6-a647-56bc63d6e008 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:19.925379 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:19.926377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:19.926754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:19.927149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:19.934541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:19.935824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:19.950351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:19.951494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:19.952440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:19.957964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 431/866] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:19.958907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:19.991963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99425858-c7a2-4876-8e2f-36735a3e6f0e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:20.030849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:20.031925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:20.032372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:20.033061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:20.033967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:20.034566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:20.036619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:20.043157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 436/867] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:20.048555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:20.080958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43463d-e662-4c64-a53b-34b785a35430 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:20.113780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:20.114550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:20.114890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:20.115232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:20.116109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:20.116623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:20.117988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:20.129751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 432/868] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:20.135756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:20.170900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40711ce9-a303-40c8-8ce6-0e3c56ff6e6d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:20.204756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:20.206446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:20.206877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:20.207286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:20.208173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:20.208611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:20.210124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08553010-2e08-49bf-b12b-e69c3403d638 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:20.216997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 437/869] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:20.240208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bbe4d-f52d-4e01-9275-0512ecddadfc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:20.276696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:20.277436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:20.277709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:20.277978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:20.278835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=907472893cec4b2ab7ee51b10aa1a214) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:20.279140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:20.280653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b2fa0-b248-446b-85ab-4198af4fdac0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:20.287820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 433/870] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:20 2022] GET /identity/v3/role_assignments?user.id=907472893cec4b2ab7ee51b10aa1a214&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:21.296715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64671-1fe8-4e1f-a4ae-fcee729794a9 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.297225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64671-1fe8-4e1f-a4ae-fcee729794a9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.297225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc64671-1fe8-4e1f-a4ae-fcee729794a9 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.298846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 438/871] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:21.304005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e32ef-55f7-4a0f-8227-5f04ded7bd4b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.304418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e32ef-55f7-4a0f-8227-5f04ded7bd4b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.304900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e32ef-55f7-4a0f-8227-5f04ded7bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.321757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-387e32ef-55f7-4a0f-8227-5f04ded7bd4b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:21.323008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-387e32ef-55f7-4a0f-8227-5f04ded7bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:21.391872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 434/872] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:21.413319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64671-1fe8-4e1f-a4ae-fcee729794a9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:21.431625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896bed-9cc5-4a4c-9dcc-872acb05028f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.431931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896bed-9cc5-4a4c-9dcc-872acb05028f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.432184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac896bed-9cc5-4a4c-9dcc-872acb05028f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.433920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 435/873] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:21.438793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.439075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.439345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.455661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:21.456833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:21.530283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 436/874] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:21.532103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc64671-1fe8-4e1f-a4ae-fcee729794a9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:21.550954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:21.570970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:21.573004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.573474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.574068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.575212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:21.577167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:21.592856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:21.593872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:21.594705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:21.596926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 439/875] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:21.603398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:21.654344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b136c0-0845-4065-870b-afc06643a5e8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:21.691430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:21.692432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.693251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.693720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.695065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:21.696887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:21.716246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad12f03-96f6-45ea-b93b-ca948ab4475d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:21.717089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 437/876] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:21 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:27:21.766352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:21.767067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.767341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.767644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.768350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:21.768647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:21.770158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf825e-6cc3-4566-b98b-4e4370f249f0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:21.776091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 440/877] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:21.781919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:21.889350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9b924-7b92-4131-9e82-239af2ecdde0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:21.924225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:21.924884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:21.925158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:21.925424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:21.926121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:21.926421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:21.927818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba65eaf-75c4-40c5-99ea-37f549eaf17c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:21.932555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 438/878] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:22.486821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109f20-a28d-49b9-bd3a-366b7a49e90d None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.487480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109f20-a28d-49b9-bd3a-366b7a49e90d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.487480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109f20-a28d-49b9-bd3a-366b7a49e90d None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.488947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 441/879] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:22.494246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557164-503f-4095-af11-37fdb3b5ea26 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.495154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557164-503f-4095-af11-37fdb3b5ea26 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.495654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32557164-503f-4095-af11-37fdb3b5ea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.512515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-32557164-503f-4095-af11-37fdb3b5ea26 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:22.513964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-32557164-503f-4095-af11-37fdb3b5ea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:22.578802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 439/880] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:22.601652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109f20-a28d-49b9-bd3a-366b7a49e90d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:22.641955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817fd4-7704-46ac-b32e-60ce23fdd918 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.642597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817fd4-7704-46ac-b32e-60ce23fdd918 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.643089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43817fd4-7704-46ac-b32e-60ce23fdd918 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.644941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 440/881] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:22.649967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.650499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.651034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.667801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:22.669311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:22.701364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109f20-a28d-49b9-bd3a-366b7a49e90d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:22.737209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:22.738251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.738745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.739220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.740163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:22.741666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:22.743454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 441/882] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:22 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:22.759783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 442/883] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:22 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:22.764936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:22.874178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72752e6d-0197-4833-b35f-cdf612d95cd5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:22.922529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:22.923709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:22.924174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:22.924643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:22.937668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:22.946170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:22.947475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:22.948658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:22.951143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 442/884] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:22.957279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.058358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac568d8a-ecaa-4322-835a-1fea55f8b903 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.095451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.096428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.096913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.097358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.098336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:23.098859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.100520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:23.109868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 443/885] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:23.115972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.215189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d495c-23ea-47d6-8461-9a04fd5452a0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.248295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.249399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.249883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.250293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.261205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.262651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:23.279253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:23.280172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:23.281058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:23.281058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:23.281058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:23.281058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:23.281058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 443/886] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:23.286447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.395562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54a574-f996-40c8-a592-19b87ba8cee3 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.435348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.436475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.436938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.437509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.438551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:23.439120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.440816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:23.455760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 444/887] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:23.463408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.560055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d79ee-9640-4ff5-8aa2-1b8617da553f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.593621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.594438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.594715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.594988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.602745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.604323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:23.618833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:23.619906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:23.620843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 444/888] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:23.626063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.728803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e9b90-27ac-4dd2-863a-3772f4b0b787 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.761714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.762377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.762649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.762964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.763874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:23.764182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.765603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:23.783074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 445/889] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:23.788582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:23.887779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1546c56-f71e-440e-8844-a882db95a95f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:23.920825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:23.921875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:23.922364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:23.922856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:23.996265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:23.998030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b9f18-62ce-4990-9678-6b78d421afd1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.103480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 445/890] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:24.106401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.135323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19a8e-804b-492b-b6f8-66b58dbccfa6 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.135653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19a8e-804b-492b-b6f8-66b58dbccfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.135934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f19a8e-804b-492b-b6f8-66b58dbccfa6 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.139413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 446/891] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:24.142397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6836d-6737-4675-be04-5dd88efdcd85 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.142673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6836d-6737-4675-be04-5dd88efdcd85 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.142941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6836d-6737-4675-be04-5dd88efdcd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.162207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-90d6836d-6737-4675-be04-5dd88efdcd85 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:24.163668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-90d6836d-6737-4675-be04-5dd88efdcd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:24.220661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a21aaa-9386-4d35-b6d2-086eec8c1718 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.247493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 447/892] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:24.247493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb227a-66ef-4720-8c80-478d7b6a6b3e None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.247493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb227a-66ef-4720-8c80-478d7b6a6b3e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.247493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb227a-66ef-4720-8c80-478d7b6a6b3e None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.247493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 448/893] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:24.249758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.250086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.250363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.269512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:24.270682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:24.273055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.274037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.274450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.274867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.285251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.286866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:24.306835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:24.307812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:24.308698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:24.308698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:24.308698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:24.308698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:24.308698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 446/894] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:24.309439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.341137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 449/895] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:24.342106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.407132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a89fd-d83b-4da6-85e8-75a7f9178965 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.437453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4fd3c-523d-460f-af3b-ed1498d979ab None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.441444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.442570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.443009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.443489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.444346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.446667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:24.458864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:24.459980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:24.460834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 447/896] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:24.461633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.473094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.473821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.474103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.474373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.475098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:24.475418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.476770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.487664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 450/897] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:24.488453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.565067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87a07d-5844-4577-83b7-49f328b07b73 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.582827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26691f5-dc80-40b5-9585-00bd204dd508 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.598367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.599031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.599309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.599607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.600327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.601692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.615753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.616411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.616690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.616959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.624804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:24.625024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 448/898] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:24 2022] POST /identity/v3/services => generated 241 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:24.625120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.625195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.625528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.625528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 451/899] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:24.630197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.734002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15258db8-152b-4daa-b0ea-e78fcf3a1d97 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.740112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a541e-de37-4a85-a062-ba662cf05239 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.768405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.769076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.769351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.769618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.770327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:24.770625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.772105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.775448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.776323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.776607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.776879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.782261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 452/900] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:24.783259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.784483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.785988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:24.802479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:24.803485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:24.804409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:24.807663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 449/901] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:24.810080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.895059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc131391-5503-47d3-a631-c11e159ef0d1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.933376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.934035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.934315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.934588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.935401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] RBAC: Adding query filter params (interface=public, service_id=ee0224392f9744f8897994e81af10c23, region_id=RegionOne) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:24.935715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.937078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:24.941387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481c878-1dac-4777-9670-e66dce07fe3d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:24.942459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 453/902] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/endpoints?service_id=ee0224392f9744f8897994e81af10c23&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:24.947411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:24.981580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:24.982960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:24.983403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:24.984070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:24.985031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:24.985480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:24.988058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.007349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 450/903] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:25.009624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.060497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a163a66f-9c92-4914-8d51-272a24a196b9 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.094706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.095366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.095670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.095942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.096619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.097976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7903-29fe-4187-9a32-98aa21c07901 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.103819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 454/904] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:24 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:27:25.105148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ff6e-a979-4449-92a5-111383954d71 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.105430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ff6e-a979-4449-92a5-111383954d71 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.105701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53ff6e-a979-4449-92a5-111383954d71 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.107193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 455/905] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:25.117265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.117702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.118074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.135412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:25.136763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:25.139129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8ba4-0781-4328-b5c7-cfe5fff3ffaf None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.188906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.189503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.189829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.190097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.190969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] RBAC: Adding query filter params (role.id=7404e3eb672a483fb4e50ddd8e41138b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=907472893cec4b2ab7ee51b10aa1a214) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:25.191284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.192734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.207416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 451/906] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/role_assignments?user.id=907472893cec4b2ab7ee51b10aa1a214&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=7404e3eb672a483fb4e50ddd8e41138b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:25.222788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 456/907] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:25.251163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.364211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23fec1-27f6-47d4-9842-23aa0ea8ec5f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.399315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.400171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.400443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.400709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.401424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.402794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:25.416895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:25.418355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:25.419425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 452/908] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:25.423033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.529248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2a06-7855-43fe-a487-d665f39719d4 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.566505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.567214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.567518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.567786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.568492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:25.568792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.570154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.575464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 457/909] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:25.580832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.678567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625ec9-7e25-4501-8a0b-bfea3c779698 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.710995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.711698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.711980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.712250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.712952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:25.713309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.714669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.720031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 453/910] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:25.725749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.822781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0a8ab-d493-4aee-bad2-3c848d1f1697 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:25.857461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:25.858115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:25.858388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:25.858663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:25.859481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] RBAC: Adding query filter params (interface=public, service_id=2de4a64359c14d3f9c79f13520b1ddab, region_id=RegionOne) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:25.859787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:25.861140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dae47-7fa3-4f6c-b5f4-af91e6e3c844 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:25.866494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 458/911] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/endpoints?service_id=2de4a64359c14d3f9c79f13520b1ddab&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:25.871841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:25.971775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6066a-4d64-41cf-b50a-555fbfd0c896 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:26.004877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:26.005542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:26.005817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:26.006087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:26.006773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:26.008162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c27b1-5735-4e79-9501-20d5f2a324eb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:26.014364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 454/912] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:25 2022] GET /identity/v3/services => generated 1497 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:27:26.956674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f92a-cf69-45c8-9bbe-0ff024210d86 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:26.957969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f92a-cf69-45c8-9bbe-0ff024210d86 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:26.958772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56f92a-cf69-45c8-9bbe-0ff024210d86 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:26.960696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 459/913] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:26.967044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:26.967944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:26.968414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:26.985499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:26.986982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:27.057648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 455/914] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:27.075915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f92a-cf69-45c8-9bbe-0ff024210d86 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.178170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56f92a-cf69-45c8-9bbe-0ff024210d86 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.211763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.212899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.213402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.213886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.214736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.216640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:27.228791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:27.229814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:27.230656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.238400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 460/915] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:27.240712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.348800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87516b9-cd86-4f60-af94-5d35a47d26ce None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.386253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.386915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.387188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.387487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.388192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:27.388491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.390157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8be2b-9358-40a3-bfd0-39ecbac08201 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.395112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 456/916] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:27.400920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.466614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fa52-d998-43ea-a826-ba918e375a0d None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.466975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fa52-d998-43ea-a826-ba918e375a0d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.467336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622fa52-d998-43ea-a826-ba918e375a0d None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.469079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 457/917] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:27.472261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a635-0ee1-4eba-a9d3-91cd51388ba7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.472603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a635-0ee1-4eba-a9d3-91cd51388ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.472935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95a635-0ee1-4eba-a9d3-91cd51388ba7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.474233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 458/918] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:27.475314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.475747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.476085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.492427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:27.493584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:27.500918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2657f99-9496-4fc7-9fab-49fe41771289 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.533448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.534356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.534634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.534907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.535652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:27.535957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.537328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc1ce-0f44-4af1-b322-5e4c92daa492 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.542066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 461/919] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:27.543316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.543630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.543905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.559873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:27.561041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:27.564261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 459/920] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:27.565253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.639402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 462/921] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:27.639402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.681253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e51264-7ed2-4063-aa10-b48fa91fa5ca None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.716028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.717163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.717381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.717647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.718440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] RBAC: Adding query filter params (interface=public, service_id=5fa068b102d3439e91bc2cb51c5df06c, region_id=RegionOne) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:27.718743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.720140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.725657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 460/922] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/endpoints?service_id=5fa068b102d3439e91bc2cb51c5df06c&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:27.726194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.734012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1175ea-2499-4ec6-aa12-5ba69d14612b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.766170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.766965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.767236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.767533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.768173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.769521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:27.781031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:27.782016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:27.782837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 463/923] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:27.783671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.830634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826a4a4-a212-43f5-8122-21c54d6e14c1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.864605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.865423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.865674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.865955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.875783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:27.878877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672d5e8-7738-4fa8-985b-461a6d712de3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:27.883791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:27.884715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:27.885721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:27.890142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 461/924] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:27.890721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:27.914291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:27.914949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:27.915238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:27.915525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:27.916244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:27.917681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:27.935424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 464/925] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services => generated 1497 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:27:27.935424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.008451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622153cf-a8b0-49d9-9506-d787c1456c0a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.040008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c1332-4274-4df5-89e7-0384289ecd7d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.044695 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.045451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.045795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.046177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.046999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.047367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.048860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.059200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 462/926] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:28.060337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.075112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.075831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.076112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.076386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.077149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.077456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.078906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.088597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 465/927] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:28.095894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.186987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d7acb-1a97-46dd-ae21-1d945045726f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.209892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5cd6d-7bbc-4a28-b7b7-86aa8d3dee55 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.228303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.229418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.229707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.229983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.230988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.231290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.233409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.240665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 463/928] 10.222.0.23 () {56 vars in 1114 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:28.245916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.246283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.246735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.247016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.247288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.261965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.263692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-8eeb3059-639e-44b7-9b51-7d07ac008312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:28.283346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:28.284320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:28.285230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:28.285230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:28.285230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:28.285230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:28.285929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 466/929] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:28.287210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd95f-9a93-4064-8168-7af0696e71c5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.287529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd95f-9a93-4064-8168-7af0696e71c5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.287821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadd95f-9a93-4064-8168-7af0696e71c5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.289080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 467/930] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:28.291458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd95f-9a93-4064-8168-7af0696e71c5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.365571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caf225-d81d-447f-bf0f-467e65c0e0a9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.390001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadd95f-9a93-4064-8168-7af0696e71c5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.400141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.400909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.401183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.401455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.402184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.403583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9dbcb-964e-435c-b566-2f1795ac8bcb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.422577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 464/931] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:28.423858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.424141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.424462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.438175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.439225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.439751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.440213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.441354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.441829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:28.442081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.443046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:28.443942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.464845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 468/932] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:28.468413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.520629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 465/933] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:28.543647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.587900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df9d54-c167-4471-a8f5-a7b50872ec91 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.628129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.628953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.629235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.629509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.637278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.638726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:28.656888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:28.657889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:28.658850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 469/934] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:28.664983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.678857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d57b77-9c51-4a27-9808-7c7838e7c846 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.716560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.717829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.718363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.718634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.719458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.721562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:28.737247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:28.738216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:28.739147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 466/935] 10.222.0.23 () {56 vars in 1132 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:28.744933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.780301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3597a-82ed-4498-8136-9547249b656e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.822250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.823137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.823441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.823723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.825190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.825502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.827372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.842260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192192c5-1377-4f1d-88ed-8aaf10bfbb28 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:28.855659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 470/936] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:28.856669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.887998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:28.889002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:28.889286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:28.889824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:28.890547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:28.890988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:28.892957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:28.899055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 467/937] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:28.905333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:28.974281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430bf32-44ce-4e2e-881c-6dac6ffdcfbf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.008212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.009349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.009855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.010370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.011228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b76b09-fe41-4598-bb92-0c6104afa4f6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.021508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.023252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:29.042238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:29.043759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:29.044863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:29.044863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:29.044863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:29.044863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:29.046998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 471/938] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:29.051657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.052428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.052785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.052983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:29.053127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.053961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:29.054346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.055820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.066017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 468/939] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:29.067500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:29.155845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81117053-3d6f-4091-8181-300c7997ab3d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.166473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277cc760-90a3-4141-8b31-ef7dda47fe74 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.189772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.190280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.190556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.190869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.191629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:29.191933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.193295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.201307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.202205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.202669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.203149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.204107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.205639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.209296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 472/940] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:29.210359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:29.231408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 469/941] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:29.326835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d55ad31-afa8-45b3-b4ad-63ca021f51ec None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.367959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.368816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.369099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.369409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.381298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.382752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:29.398055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:29.399033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:29.400624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 473/942] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:29.405445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:29.511220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e33af-b909-47c6-a2e6-abd3839ad28c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.544416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.545430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.545930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.546421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.547444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:29.547963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.549580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9201bb-0efc-4afa-8538-fc1772a3827f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.562432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 470/943] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:29.568092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:29.668328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe8a93-971c-4582-88bf-e12aac687ec7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:29.702477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:29.703395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:29.703671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:29.703941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/907472893cec4b2ab7ee51b10aa1a214/roles/7404e3eb672a483fb4e50ddd8e41138b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:29.706145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=907472893cec4b2ab7ee51b10aa1a214, role_id=7404e3eb672a483fb4e50ddd8e41138b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:29.707605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6af028-716b-426a-b477-9856d2dd1e85 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:29.722683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 474/944] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:29 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/907472893cec4b2ab7ee51b10aa1a214/roles/7404e3eb672a483fb4e50ddd8e41138b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:27:30.378888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037bff4-ebd5-46bb-ad4d-2e4f96d6b9b7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.379439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037bff4-ebd5-46bb-ad4d-2e4f96d6b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.379439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037bff4-ebd5-46bb-ad4d-2e4f96d6b9b7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.381205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 471/945] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:30.386637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.387092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.387170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.419404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:30.419404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:30.537886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 475/946] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:30.561738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037bff4-ebd5-46bb-ad4d-2e4f96d6b9b7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:30.662901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037bff4-ebd5-46bb-ad4d-2e4f96d6b9b7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:30.699787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:30.700617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.700894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.701166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.701826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:30.703232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:30.716347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:30.717477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:30.718320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 472/947] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:30.725538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:30.820199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d59f42-c03b-48d1-bc21-6be56b4c3361 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:30.859970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:30.860646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.860931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.861206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.861987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:30.862341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:30.863798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825e3a0-c012-4944-a3bb-6224edeeef06 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:30.869363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 476/948] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:30.875156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:30.903032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9c9a-b922-4c83-8cb0-a6f309aeab40 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.903371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9c9a-b922-4c83-8cb0-a6f309aeab40 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.903623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9c9a-b922-4c83-8cb0-a6f309aeab40 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.905254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 477/949] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:30.915413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df037f-0b39-4133-989e-8c730441a34f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:30.915413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df037f-0b39-4133-989e-8c730441a34f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:30.915413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df037f-0b39-4133-989e-8c730441a34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:30.928274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-64df037f-0b39-4133-989e-8c730441a34f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:30.929455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-64df037f-0b39-4133-989e-8c730441a34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:30.987295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402124a2-b156-41a1-9661-b6535ae89937 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.025345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 478/950] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:31.028607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.029272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.029553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.029828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.030534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:31.030840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.032267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.037621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 473/951] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:31.048084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:31.048235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df037f-0b39-4133-989e-8c730441a34f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:31.146539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df037f-0b39-4133-989e-8c730441a34f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.153607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37ea8-a9f9-4936-9f9d-14f19f65c437 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.180293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.181121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.181395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.182090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.183055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.184592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.185993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING keystone.server.flask.common [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 21:27:31.186970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.187884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.188358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.188821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.189740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.191290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.205331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.sql.core [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:27:31.205331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 21:27:31.205331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [parameters: {'id': '32d370d58adc4e778f8447bc7d445a73', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 21:27:31.205331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80010) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:27:31.214036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 474/952] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 32d370d58adc4e778f8447bc7d445a73.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 32d370d58adc4e778f8447bc7d445a73. May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application conn.query(q) May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:27:31.216754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result.read() May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 04 21:27:31.217586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return project_ref.to_dict() May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application next(self.gen) May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application yield resource May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application next(self.gen) May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise self.value May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application session.commit() May 04 21:27:31.218552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.session.flush() May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application compat.raise_( May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:27:31.219506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application c = connection._execute_20( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:27:31.220426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application conn.query(q) May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application result.read() May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:27:31.221220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [parameters: {'id': '32d370d58adc4e778f8447bc7d445a73', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.222162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:31.223075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.Conflict( May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 32d370d58adc4e778f8447bc7d445a73. May 04 21:27:31.224020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:31.226511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 479/953] 10.222.0.23 () {60 vars in 1140 bytes} [Wed May 4 21:27:31 2022] POST /identity/v3/projects => generated 262 bytes in 179 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:31.236661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:31.361999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc5620-2633-4fa9-b444-0fa1cc25f45b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.397095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.397895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.398179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.398502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.406038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.407572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-cf869903-7280-4407-af24-56d4aa39bbbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:31.424120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:31.426302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:31.428451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:31.435413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 475/954] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:31.435694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:31.536683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a97ee-0c70-4c1e-bf97-829633e28157 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.569408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.570130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.570414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.570688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.571497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:31.571805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.573507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a928b9-00eb-476e-834e-b1225c2baacd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.599541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 480/955] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:31.611936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9558-2bd4-44b0-853f-fbd04fabc27b None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.612306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9558-2bd4-44b0-853f-fbd04fabc27b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.612462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db9558-2bd4-44b0-853f-fbd04fabc27b None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.614213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 476/956] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:31.620189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.620525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.620735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.639286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:31.640862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:31.715046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 481/957] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:31.736976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db9558-2bd4-44b0-853f-fbd04fabc27b None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:31.843718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db9558-2bd4-44b0-853f-fbd04fabc27b None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:31.880118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:31.880911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:31.881183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:31.881451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:31.882102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:31.883495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:31.895152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:31.897383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:31.899261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 477/958] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:31.904583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.009316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf50cc-8c6c-43a8-9aa9-d64be492119f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.042562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.043223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.043529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.043798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.044502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:32.044803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:32.046167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89620693-155a-47ca-a65e-b485995d4c51 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:32.051305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 482/959] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:32.060262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.136251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b07f39-2e11-4e67-97ff-300363382a28 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.136604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b07f39-2e11-4e67-97ff-300363382a28 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.136783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b07f39-2e11-4e67-97ff-300363382a28 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.138831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 483/960] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:32.143702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.143984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.144258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.160949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:32.162220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:32.164908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e73e50-c2a7-453e-a1fc-775e2c33a937 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.198251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.198919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.199200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.199503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.200218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:32.200523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:32.201901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:32.206880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 478/961] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:32.230579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 484/962] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:32.254033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.357517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03497446-92b1-49e8-a8b6-0e452eec0719 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.394646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.395823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.396267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.396684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.408778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:32.417759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:32.418910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:32.420017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:32.422469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 479/963] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:32.428260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.530258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e805a24-d770-438d-a58c-255c6ba13e97 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.562320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.562976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.563249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.563550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.564336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:32.564636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:32.565978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:32.574190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 485/964] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:32.579816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.677970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48021565-481e-43fb-b45c-de18d92a8774 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.711444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.712614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.713173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.713690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.725265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:32.726967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:32.744914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:32.745842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:32.746729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:32.746729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:32.746729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:32.746729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:32.753446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 480/965] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:32.755001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:32.852255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a1d0a-fa69-48b2-8925-3b97adf434ae None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:32.890713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:32.891392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:32.891685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:32.891955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:32.892672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:32.892974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:32.894331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:32.906641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 486/966] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:32.912228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.012533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe969a-2fdf-4bf1-958e-5322788e64f6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.048034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.049233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.049736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.050208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.059330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.061072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:33.076140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:33.077101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 04 21:27:33.078046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:33.084272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 481/967] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:27:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:33.086729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.185353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f4e50-6a2c-4b45-9662-f9dcd7c4b543 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.223365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.224052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.224333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.224599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.225442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:33.225743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.227162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.246003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 487/968] 10.222.0.23 () {56 vars in 1149 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:33.251313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.356970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dac5e1-99ae-4735-a6b9-c3e4704a8f7c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.393665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.394749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.395235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.395746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.466802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.468267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8d2c0-be9c-4aee-b07e-c017f8d65c77 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.569031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 482/969] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:33.575403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.583616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dcf2-60bf-4f73-ab74-4bf22d72df9c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.583896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dcf2-60bf-4f73-ab74-4bf22d72df9c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.584166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dcf2-60bf-4f73-ab74-4bf22d72df9c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.585841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 483/970] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:33.591755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.591755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.591755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.612256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:33.613504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:33.682535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b5bf5-bb5d-4567-82fb-5300b0d80fff None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.703414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 484/971] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:33.723609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.723878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.724657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.724936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.725206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.735727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.737182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:33.754781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:33.755725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:33.756646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:33.756646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:33.756646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:33.756646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:33.756646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 488/972] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:33.764055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.844655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857943c-015e-413e-ac0d-aefe72734c99 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.889279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.890002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.890278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.890594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.891201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.893293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.898635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e6ccd-8ef2-4750-96ca-23297622f51a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:33.907092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:33.908297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:33.909798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 485/973] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:33.914021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:33.942025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:33.942693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:33.942974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:33.943252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:33.944043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:33.944347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:33.945713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:33.961521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 489/974] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:33.962873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.037497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb8ecd-8da2-478e-9e1c-a565103686f2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.060164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a111d6-e470-4a85-94d6-99cd29fa21aa None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.074424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.075098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.075400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.075723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.076422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.076727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.078106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c2c02-0d82-4d46-9f4d-0fd53ca37105 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.087764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 486/975] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:34.087764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9d0d-2556-43c9-a467-369581ae61a2 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.087764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9d0d-2556-43c9-a467-369581ae61a2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.087764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc9d0d-2556-43c9-a467-369581ae61a2 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.087764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 487/976] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:34.091696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9d0d-2556-43c9-a467-369581ae61a2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.100876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.101750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.102029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.102293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.109100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.110527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-20afe2ce-8929-494f-b170-9c086f4fcbaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:34.124225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:34.125103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:34.126029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 490/977] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:34.126595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.127195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.127195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.142896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:34.144022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:34.197732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc9d0d-2556-43c9-a467-369581ae61a2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.207424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 491/978] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:34.208231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.241363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.242147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.242496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.242838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.243651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.244072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.245520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.251441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 488/979] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:34.256006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.311063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd531b-8871-4172-8f34-8280a710c242 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.343633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.344320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.344598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.344872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.345684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.345996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.347499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.352838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36650dc1-401d-464f-a9b9-2e48ff87f525 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.365263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 492/980] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:34.365263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.395706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.396305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.396589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.396867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.397568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.399004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.400412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING keystone.server.flask.common [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 04 21:27:34.413013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.sql.core [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:27:34.413013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 21:27:34.413013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [parameters: {'user_id': 'd40d46b7a7de439aa7e1d24aa99b59f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 21:27:34.413013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80011) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application conn.query(q) May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application result.read() May 04 21:27:34.434241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:27:34.435190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application next(self.gen) May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application yield resource May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application next(self.gen) May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self.session.rollback() May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self.force_reraise() May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise self.value May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application session.commit() May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 04 21:27:34.436373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._prepare_impl() May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self.session.flush() May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._flush(objects) May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application compat.raise_( May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application flush_context.execute() May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rec.execute(self) May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 04 21:27:34.438039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application _emit_insert_statements( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application result = connection._execute_20( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ret = self._execute_context( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 04 21:27:34.438934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self.dialect.do_execute( May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application result = self._query(query) May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application conn.query(q) May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application result.read() May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 04 21:27:34.439859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application packet.raise_for_error() May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd40d46b7a7de439aa7e1d24aa99b59f7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:34.440715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 04 21:27:34.442968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 489/981] 10.222.0.23 () {60 vars in 1131 bytes} [Wed May 4 21:27:34 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:34.445172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.469334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874eb9b-5bd2-464f-acd6-053e4553e223 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.502933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.503795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.504178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.504547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.505454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] RBAC: Adding query filter params (interface=admin, service_id=5fa068b102d3439e91bc2cb51c5df06c, region_id=RegionOne) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.505863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.507325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.517112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 493/982] 10.222.0.23 () {56 vars in 1249 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/endpoints?service_id=5fa068b102d3439e91bc2cb51c5df06c&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:34.517112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.538565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc6c8e-ae9b-46cc-9d3d-b1639feea8c4 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.570807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.571492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.571773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.572136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.573010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] RBAC: Adding query filter params (role.id=7404e3eb672a483fb4e50ddd8e41138b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=907472893cec4b2ab7ee51b10aa1a214) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.573318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.574943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.583474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 490/983] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/role_assignments?user.id=907472893cec4b2ab7ee51b10aa1a214&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=7404e3eb672a483fb4e50ddd8e41138b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:34.584242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.615186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb1d9-9135-4ca0-9212-63fab679d50a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.650497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.651229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.651543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.651824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.660178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.661639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-3d3a6861-dc47-470b-9d42-ee0d1c9174c6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:34.678449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:34.679715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 04 21:27:34.680963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:34.683742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 494/984] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:34.685434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311141-f70f-4b0a-873b-315618dd7e2c None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.685714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311141-f70f-4b0a-873b-315618dd7e2c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.685992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21311141-f70f-4b0a-873b-315618dd7e2c None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.687417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 495/985] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:34.688158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311141-f70f-4b0a-873b-315618dd7e2c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.693529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50663f64-ce38-44c8-a7e0-fcff17498cec None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.729478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.730165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.730974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.731255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.731988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.733375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372af03b-ca95-44ff-a310-490be5697965 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.739876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 491/986] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:27:34.741342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.741633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.741913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.761806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:34.763440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:34.822507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21311141-f70f-4b0a-873b-315618dd7e2c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:34.848204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 492/987] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:34.864351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:34.871888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:34.872740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:34.873114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:34.873481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:34.874653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:34.874798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:34.876373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3693d7-35d5-4592-9a71-9b95d606fdd0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:34.914469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 496/988] 10.222.0.23 () {56 vars in 1101 bytes} [Wed May 4 21:27:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:34.974752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c5b13-149f-4eb3-ae36-aa3306c92f6f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:35.012461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:35.013802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:35.014472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:35.014946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:35.015870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:35.017692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125af4d-7d0f-4d83-92d6-a45c398ea93b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:35.034858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 493/989] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:34 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:27:36.896639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41abe2-1e4d-4837-b2f3-7ab1fbcf94d0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:36.897187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41abe2-1e4d-4837-b2f3-7ab1fbcf94d0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:36.897187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41abe2-1e4d-4837-b2f3-7ab1fbcf94d0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:36.898711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 497/990] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:36.903821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd4fb-ff4f-4bf5-8537-a3adacd7b3e6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:36.904260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd4fb-ff4f-4bf5-8537-a3adacd7b3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:36.904348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd4fb-ff4f-4bf5-8537-a3adacd7b3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:36.922900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9d3dd4fb-ff4f-4bf5-8537-a3adacd7b3e6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:36.924127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9d3dd4fb-ff4f-4bf5-8537-a3adacd7b3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:36.997345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 494/991] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:37.002620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe528-9626-4c7d-9115-f3eba6082563 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.002918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe528-9626-4c7d-9115-f3eba6082563 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.003164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffe528-9626-4c7d-9115-f3eba6082563 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.004729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 498/992] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:37.009713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.010001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.010278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.018792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe528-9626-4c7d-9115-f3eba6082563 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.029493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:37.032272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:37.099615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 495/993] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:37.123213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.128425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffe528-9626-4c7d-9115-f3eba6082563 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.160494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.161212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.161485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.161755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] PATH_INFO: `/v3/services/image` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.162399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.163803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:37.175030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:37.176057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:37.176904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:37.179696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 499/994] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:37.181997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.220098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff504e-f6c1-4b4b-a05d-5c27167d63a8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.253766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.254582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.254863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.255136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.255838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.257203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:37.269460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:37.270477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.271319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 496/995] 10.222.0.23 () {56 vars in 1126 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:37.276660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.289404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92068b77-cce3-411e-b48f-413e34cf61bc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.322259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.322921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.323193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.323494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.324190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] RBAC: Adding query filter params (name=image) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.324493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.325843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4482f-86d9-4c04-b30e-fe2367a5a68b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.330414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 500/996] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:37.331601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686f33-f888-44e0-bb70-8fa930b6cd4f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.331884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686f33-f888-44e0-bb70-8fa930b6cd4f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.332182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50686f33-f888-44e0-bb70-8fa930b6cd4f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.333505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 501/997] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:37.336059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50686f33-f888-44e0-bb70-8fa930b6cd4f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.370142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162f355-47cf-4a80-91e2-f26b978c106b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.401160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.401817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.402101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.402378 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.403088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.403412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.404776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a461b-5409-4b40-8cb5-94997fd7cacc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.409473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 497/998] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:37.410637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a230-7870-497f-b779-c9041c885984 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.411108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a230-7870-497f-b779-c9041c885984 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.411214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0a230-7870-497f-b779-c9041c885984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.426920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-29b0a230-7870-497f-b779-c9041c885984 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:37.428116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-29b0a230-7870-497f-b779-c9041c885984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:37.432860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50686f33-f888-44e0-bb70-8fa930b6cd4f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.463713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.464364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.464640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.464905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.465594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.466209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.467685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.471975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 502/999] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:37.472715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.503944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 498/1000] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:37.527263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a230-7870-497f-b779-c9041c885984 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.578031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b80a39-665c-4bf9-9b20-c884a6eb5da2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.611505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.612178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.612453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.612717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.613429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.613725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.615097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.625506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 503/1001] 10.222.0.23 () {56 vars in 1122 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:37.626507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.627105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0a230-7870-497f-b779-c9041c885984 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.663132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.663487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.663711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.665558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.665558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.666186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:37.679607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:37.680640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:37.681576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 499/1002] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:37.687228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.734634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ac40c-1e72-4d00-82d1-d4f900e264ac None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.766196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.766856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.767142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.767442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.768279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.769656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.783213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0264b9e8-e5da-4641-8ab1-ae0c1656caa6 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.785291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 504/1003] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:37 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:37.824506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.825185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.825465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.825794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.826449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.826751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.828187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.833761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 500/1004] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:37.839424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:37.948600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46fbce-70c8-4259-8169-b1c7548f76b1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:37.983509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:37.984189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:37.984468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:37.984717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:37.985427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:37.985728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:37.987091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:37.992154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 505/1005] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:37.998069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:38.096323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d7e3b-877b-49c1-98ba-71069f952229 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:38.129231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:38.129888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:38.130169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:38.130438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:38.131229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] RBAC: Adding query filter params (interface=public, service_id=f7b174c5436f4b74a43311ade3e63bf6, region_id=RegionOne) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:38.131578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:38.132938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1727c-1ae0-4ad5-b238-59bd0cb7e453 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:38.138313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 501/1006] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:37 2022] GET /identity/v3/endpoints?service_id=f7b174c5436f4b74a43311ade3e63bf6&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:38.143827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:38.244551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7afc8-be17-4acd-ab2f-da6397f9a5fd None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:38.277579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:38.278242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:38.278520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:38.278789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:38.279488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:38.280847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada32cd5-eabe-4270-a2b0-110ea1d59145 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:38.286995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 506/1007] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:38 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:27:39.722011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ca-7181-4f6f-b9c8-e1500c315cd2 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:39.722567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ca-7181-4f6f-b9c8-e1500c315cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:39.722567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4316ca-7181-4f6f-b9c8-e1500c315cd2 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:39.724160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 502/1008] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:39.729204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3332-863c-485c-b73d-67e8bdd91317 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:39.729599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3332-863c-485c-b73d-67e8bdd91317 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:39.729764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da3332-863c-485c-b73d-67e8bdd91317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:39.746600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-63da3332-863c-485c-b73d-67e8bdd91317 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:39.747816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-63da3332-863c-485c-b73d-67e8bdd91317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:39.813324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 507/1009] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:39 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:39.836193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4316ca-7181-4f6f-b9c8-e1500c315cd2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:39.943833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4316ca-7181-4f6f-b9c8-e1500c315cd2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:39.978583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:39.979609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:39.980097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:39.980556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:39.981479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:39.983026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04982bc2-b082-4e34-8108-5ab73f1fdbd3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:39.998233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 503/1010] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:39 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:40.048458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888d9f-9f0a-4f37-907d-638508327afd None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.048709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888d9f-9f0a-4f37-907d-638508327afd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.049226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888d9f-9f0a-4f37-907d-638508327afd None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.050600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 508/1011] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:40.056652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.056992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.057186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.078365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:40.079627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:40.156353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 504/1012] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:40.179812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64888d9f-9f0a-4f37-907d-638508327afd None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:40.278567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64888d9f-9f0a-4f37-907d-638508327afd None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:40.314745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:40.315647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.315927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.316174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.317512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:40.318999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb26c-1f09-46d7-94a0-149f1db58cc6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:40.321095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 509/1013] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:40.327089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:40.425520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411a516-ce4f-4231-94a2-b99d9ff8c2b3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:40.460497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:40.461171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.461449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.461722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.462501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:40.463971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60da30-d479-4b74-973e-b24ccafc15af None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:40.491480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 505/1014] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:27:40 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:40.491684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da410f62-8631-4de6-905a-c3c5310f9c79 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.491992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da410f62-8631-4de6-905a-c3c5310f9c79 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.492339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da410f62-8631-4de6-905a-c3c5310f9c79 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.493977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 510/1015] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:40.501187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.501520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.501722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.520433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:40.521531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:40.593774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 506/1016] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:40 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:40.616814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da410f62-8631-4de6-905a-c3c5310f9c79 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:40.721473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da410f62-8631-4de6-905a-c3c5310f9c79 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:40.753727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:40.754513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.754789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.755053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.755720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:40.757054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:40.768505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:40.769728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:40.770839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 511/1017] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:40.775903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:40.873467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b83c59-e244-4c2b-8ca2-ec8b6ebc5f97 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:40.907451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:40.908111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:40.908384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:40.908651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:40.909370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] RBAC: Adding query filter params (name=compute) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:40.909664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:40.911035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:40.915903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 507/1018] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:40.921782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:41.016689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368bab3-22c2-44f1-8458-0c9769ef13e8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:41.050266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:41.050836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:41.051109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:41.051388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:41.052110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:41.052406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:41.053768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b62daa-ca58-4a8b-a547-b6b452f4d813 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:41.064475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 512/1019] 10.222.0.23 () {56 vars in 1112 bytes} [Wed May 4 21:27:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:41.065658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:41.170116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8921a7-56a5-4bf1-81db-9bbfd8fd41de None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:41.204459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:41.205093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:41.205385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:41.205651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:41.206383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:41.207767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940cc5f-2ca8-46c3-b55d-4ab8ad0ef7ce None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:41.231408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 508/1020] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:42.263875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be732c5-2afe-4bcd-b60d-44a838572001 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.264345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be732c5-2afe-4bcd-b60d-44a838572001 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.264425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be732c5-2afe-4bcd-b60d-44a838572001 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.265753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 513/1021] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:42.271134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.271584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.271684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.288713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:42.289874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:42.362721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 509/1022] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:42.385710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be732c5-2afe-4bcd-b60d-44a838572001 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.489333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be732c5-2afe-4bcd-b60d-44a838572001 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:42.522226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46817-9224-4291-84af-be517c222b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:42.522944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46817-9224-4291-84af-be517c222b93 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.523224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46817-9224-4291-84af-be517c222b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.523520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be46817-9224-4291-84af-be517c222b93 None admin] PATH_INFO: `/v3/services/image` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.524197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be46817-9224-4291-84af-be517c222b93 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:42.525568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be46817-9224-4291-84af-be517c222b93 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-8be46817-9224-4291-84af-be517c222b93 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:42.536903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:42.537948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:42.538784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:42.543211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 514/1023] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:42.544152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.645787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3ed53-4ad8-450e-9db6-a712a8bca7e3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:42.679781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:42.680441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.680714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.680983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.681726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:42.682020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:42.683406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6de68e-d117-4fb5-9468-e70d86b7abc3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:42.688370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 510/1024] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:42.694021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46817-9224-4291-84af-be517c222b93 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.740039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34559-8d7d-4f68-8b97-aadf1b789f9d None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.740270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34559-8d7d-4f68-8b97-aadf1b789f9d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.740557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e34559-8d7d-4f68-8b97-aadf1b789f9d None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.742100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 511/1025] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:42.746922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.747174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.747500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.763769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:42.764927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:42.791095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be46817-9224-4291-84af-be517c222b93 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:42.823537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:42.824197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.824477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.824749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.825449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] RBAC: Adding query filter params (type=image) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:42.825753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:42.827114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:42.831414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 512/1026] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:42.835427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 515/1027] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:42.837819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.853760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.931906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93490c49-ba01-4512-9748-585bc7a66589 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:42.948691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb2996-3685-423c-9027-a2fd097f6772 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:42.964550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:42.965224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.965501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.966119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.966914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] RBAC: Adding query filter params (interface=public, service_id=ef12674ae49246a2bd5f19eee3858cf6, region_id=RegionOne) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:42.967217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:42.968616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:42.973659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 513/1028] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/endpoints?service_id=ef12674ae49246a2bd5f19eee3858cf6&interface=public®ion_id=RegionOne => generated 194 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:42.979269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:42.982653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:42.983685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:42.983967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:42.984246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:42.985435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:42.986882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:42.988765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 516/1029] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:42.994217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:43.078050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9467e-6ac8-45bd-95b4-84ae9e56a474 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:43.092480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bed23-f345-462e-979b-b0e05d3a5d3e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:43.110596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:43.111320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.111627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.111896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.112577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:43.113938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a66d3-1346-4e83-b6ed-a1fc4499f967 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:43.120808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 514/1030] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:27:42 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:27:43.124463 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:43.125160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.125425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.125697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.126420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:43.127921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144d727-a5e5-417d-8d1c-229d32dee994 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:43.152341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 517/1031] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:27:42 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:43.566129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabc38-f36b-4ad7-9f81-3d9074f4bdcf None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.566647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabc38-f36b-4ad7-9f81-3d9074f4bdcf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.566647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eabc38-f36b-4ad7-9f81-3d9074f4bdcf None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.568184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 515/1032] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:43.573364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.573773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.573871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.591828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:43.593001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:43.659190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 518/1033] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:43.682691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eabc38-f36b-4ad7-9f81-3d9074f4bdcf None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:43.781890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eabc38-f36b-4ad7-9f81-3d9074f4bdcf None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:43.815260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:43.816080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.816416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.816603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.826508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:43.834501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:43.835482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:43.836333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 516/1034] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:43.845831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:43.942048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aa974-d23d-48a2-a2e9-7ab0ac2cc444 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:43.976465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:43.977371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:43.977855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:43.978282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:43.979168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:43.979639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:43.981144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:43.989384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 519/1035] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:43.995222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:44.097160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2eb1a-6401-4972-b71e-73fbc7e60b78 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:44.131559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:44.132595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:44.133024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:44.133468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:44.144293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:44.145901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:44.163255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:44.164215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:44.165208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:44.165208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:44.165208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:44.165208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:44.165208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 517/1036] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:44.170276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:44.278714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e8748-8781-45a6-96fb-3519f855ef16 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:44.310626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:44.311281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:44.311585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:44.311854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:44.312562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:44.312857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:44.314202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:44.325727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 520/1037] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:44.331217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:44.431679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df019f-e6fe-4acf-ac2e-365ee826a52b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:44.464206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:44.464986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:44.465258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:44.465850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:44.473199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:44.474622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:44.488139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:44.489067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:44.490070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:44.491242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 518/1038] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:44.495122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:44.589690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68113300-f21a-437b-8286-aed547268dd2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:44.622700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:44.623373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:44.623708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:44.623987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:44.624828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:44.625135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:44.626555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:44.649114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 521/1039] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:44.650630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:44.751046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddc2df-6f35-4c9f-abd0-28003e252028 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:44.784912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:44.785560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:44.785840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:44.786115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:44.853252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:44.854710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:44.948993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 519/1040] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:44.954633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.053746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1607ab-d4da-4981-a008-c99f424b1013 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.087954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.088757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.089037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.089314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.099773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.101215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:45.119368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:45.120320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:45.121222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:45.121222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:45.121222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:45.121222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:45.123748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 522/1041] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:45.126328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.228220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0415a64-52ba-4aa7-a12c-5265b08e6028 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.263697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.264367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.264646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.264909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.265647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:45.265951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.267353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55294ad-dbd6-4d47-849e-ff150b8d399d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.280547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 520/1042] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:45.286171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.362476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706775-4e04-4ccc-a047-449a7bd23938 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.362834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706775-4e04-4ccc-a047-449a7bd23938 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.363014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6706775-4e04-4ccc-a047-449a7bd23938 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.364654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 521/1043] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:45.369439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815595-fd53-46c8-b329-679dcd229716 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.369723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815595-fd53-46c8-b329-679dcd229716 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.369994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b815595-fd53-46c8-b329-679dcd229716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.384084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24528eb-55e5-421e-9367-f238583c47a0 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.386256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2b815595-fd53-46c8-b329-679dcd229716 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:45.387437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2b815595-fd53-46c8-b329-679dcd229716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:45.417898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.418941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.419213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.419512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.426168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.427624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:45.441165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:45.442103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:45.447929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 523/1044] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:45.448435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.451861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 522/1045] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:45.457301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422903e-a795-47da-b575-1fbf77d01646 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.457591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422903e-a795-47da-b575-1fbf77d01646 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.457867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422903e-a795-47da-b575-1fbf77d01646 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.462960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 523/1046] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:45.464091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.464381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.464685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.483590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:45.484772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:45.542757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a908-0ff3-48d2-8d6c-684b41a91aaf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.547659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 524/1047] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:45.548480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.574365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.575017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.575292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.575601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.576385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:45.576685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.578097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.589746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 524/1048] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:45.590401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.642019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee5e2d-3b7a-4bd2-9dc0-3641c7d2cda8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.673457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.674353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.674635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.674902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.675576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.676942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.679623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420af014-4643-4f71-ada8-c3ed9cdf9340 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:45.688520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:45.689635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:45.690574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 525/1049] 10.222.0.23 () {56 vars in 1105 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/services/image => generated 86 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:45.691365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.714794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.715919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.716191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.716443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.726056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:45.733547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:45.734477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:45.735336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 525/1050] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:45.736225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.791244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6cda-4033-4c15-95ef-706ea2617bc8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.822222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.822866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.823136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.823449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.824269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] RBAC: Adding query filter params (role.id=7404e3eb672a483fb4e50ddd8e41138b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:45.824576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.826029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.830680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08649d01-1a25-490d-a596-6d04de8999c3 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.831244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 526/1051] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=7404e3eb672a483fb4e50ddd8e41138b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:45.832014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.873931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.874823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.875101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.875372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.876126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:45.876423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.877863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.883720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 526/1052] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:45.890878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:45.946807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a909dd-5099-4e51-a30e-e20c80adb84e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.981502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:45.982537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:45.982984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:45.983462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:45.984414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:45.984899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:45.986490 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:45.992904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dd53f-5dfb-4158-b6a4-adac5920a4a9 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:45.995658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 527/1053] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:46.001433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:46.029119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.029802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.030088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.030365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.031082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] RBAC: Adding query filter params (type=image) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:46.031420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.032816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.042631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 527/1054] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:46.043687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:46.101963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79769e-5d22-4a34-9559-56f661ad6f19 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:46.133894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.134828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.135109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.135408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] PATH_INFO: `/v3/users/91baa75d95f14c9f905e7abc61194b33` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.143534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6b14c-9df4-436a-844d-de179d456014 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:46.148576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] RBAC: Authorizing `identity:get_user(user_id=91baa75d95f14c9f905e7abc61194b33)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.150084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.151821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 528/1055] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:27:46 2022] GET /identity/v3/users/91baa75d95f14c9f905e7abc61194b33 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:46.157397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:46.179648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.180305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.180588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.181104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.181653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.183106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.211493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 528/1056] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:27:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:27:46.266335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c43a7-6d4f-46bc-a129-2ceebd94ff50 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:46.312448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.313110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.313390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.313663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.385430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.386876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.480007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 529/1057] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:27:46.485880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:46.580287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50d11f-1e34-4bdf-96ae-31fd1afc12bf None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:46.613546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.614402 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.614804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.614938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.616104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.617524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabad6df-4517-4cc2-aed2-7e3fecd53915 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.619404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 529/1058] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:27:46 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:46.625299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:46.722675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5897b352-74d4-46f3-b125-4c34c14d1752 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:46.755245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:46.755847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:46.756118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:46.756384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:46.757212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=304f6c27cca141dda7cda1c9d70f2c72, user.id=91baa75d95f14c9f905e7abc61194b33) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:46.757514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:46.759023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc911881-09bd-4309-88ef-6499f5cbdd2a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:46.764453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 530/1059] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:46 2022] GET /identity/v3/role_assignments?user.id=91baa75d95f14c9f905e7abc61194b33&scope.project.id=304f6c27cca141dda7cda1c9d70f2c72&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:48.083241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3185db-38c5-4b28-b757-a2fd02ce8cdf None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.083825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3185db-38c5-4b28-b757-a2fd02ce8cdf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.083916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3185db-38c5-4b28-b757-a2fd02ce8cdf None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.085271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 530/1060] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:48.091037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.091523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.091603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.108560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:48.109728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:48.176390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 531/1061] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:48.198664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3185db-38c5-4b28-b757-a2fd02ce8cdf None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.304930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3185db-38c5-4b28-b757-a2fd02ce8cdf None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.337539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.338278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.338558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.338833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.350389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-e1065f42-6d35-4934-a02b-d84743125c4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:48.359094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:48.360157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:48.361103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:48.367738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 531/1062] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:48.368788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.445458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b1c9-3bf7-478f-a70c-b16564963d80 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.445703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b1c9-3bf7-478f-a70c-b16564963d80 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.445977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02b1c9-3bf7-478f-a70c-b16564963d80 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.448625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 532/1063] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:27:48.452483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.452787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.453273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.468828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa868e76-4f32-4d59-af79-5aea90be6fcc None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.472326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:48.473518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:48.503303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.504001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.504278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.504551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.505326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:48.505597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:48.506962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:48.515425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 532/1064] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:48.520930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.542386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 533/1065] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:27:48.567273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.624432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2a9a-65e9-4d37-8b66-bad51c63e242 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.656983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.657775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.658050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.658320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.664863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322194-b0a8-443c-b4e5-dbcbb99445a7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.669688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:48.671143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:48.689225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:48.690324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:48.691246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:48.691246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:48.691246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:48.691246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:48.691246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 533/1066] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:48.696097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.702607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.703258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.703568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.703840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.769399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:48.770879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:48.798260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8ec2-cc59-489a-a0ca-15e0648016ac None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.833215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.833875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.834157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.834431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:48.835153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:48.835489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:48.836868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:48.849757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 534/1067] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:48.855731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.873811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 534/1068] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:48.879618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:48.959157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fbbad-593c-42c6-ae8f-3cfc292fdc2e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.977083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7495847-789e-4295-8ece-1149ed2b7c67 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:48.994367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:48.995150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:48.995451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:48.995722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.002521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.003987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.010306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.011085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.011365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.011664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-c126c564-c46b-4abd-b7e9-24a0a06287fc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:49.018278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:49.019316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:49.020322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 535/1069] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:49.020940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693c545-9f2e-438b-a6e3-ac7d52f3c6bd None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.021158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693c545-9f2e-438b-a6e3-ac7d52f3c6bd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.021476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693c545-9f2e-438b-a6e3-ac7d52f3c6bd None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.022613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 536/1070] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:49.025050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.025537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693c545-9f2e-438b-a6e3-ac7d52f3c6bd None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.026504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-74243bcd-d341-4876-9100-25f59667d748 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:49.044154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:49.045283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:49.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:49.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:49.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:49.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:49.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 535/1071] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:49.046802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.047073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.047335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.063129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:49.064319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:49.126792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693c545-9f2e-438b-a6e3-ac7d52f3c6bd None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.128960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 536/1072] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:49.129340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.160693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.161356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.161637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.161904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.162755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:49.163059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.164523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.181362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 537/1073] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.182141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.229105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171c10b-061d-4c0e-8f82-9474cc28436f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.265475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.266136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.266382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.266655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.267371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:49.267703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.269053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.280344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 537/1074] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:49.281176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.281896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d259c-c131-4e54-9b2a-4f7f4f7f6b1a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.319803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.320626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.320902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.321256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.332513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:49.340889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:49.341926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:49.342780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 538/1075] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:49.348866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.389662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57b927-188d-472c-a0b6-8ffd1742162a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.427028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.427775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.428054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.428323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.439708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.441071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.456994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafcd6e-c1bf-4f98-9c10-84bc9f413b71 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:49.458438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:49.460591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:49.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:49.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:49.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:49.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:49.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 538/1076] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:49.465809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.498861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.499929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.499929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.500142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.500858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:49.501161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.502535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.512901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 539/1077] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.519834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.585304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea82f9-3f6a-4381-b8fb-0b0fafe02619 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.618271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.618931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.619208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.619509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.620222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:49.620519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.621687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3196-0269-4eb3-b3c8-cf02956310af None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.621860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.633108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 539/1078] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.638701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.655104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.656015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.656290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.656543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] PATH_INFO: `/v3/users/91baa75d95f14c9f905e7abc61194b33` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.657717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] RBAC: Authorizing `identity:get_user(user_id=91baa75d95f14c9f905e7abc61194b33)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.659138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.660757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 540/1079] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/users/91baa75d95f14c9f905e7abc61194b33 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.666962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.736648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c86d7-4844-47b4-b44f-e34580b1bb2b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.762781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b8c1-7eae-4603-9dd1-8446e20db6af None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.771152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.772059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.772340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.772607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.779236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.780691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:49.794341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:49.795278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:49.796209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 540/1080] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:49.799519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.800473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.800750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.801019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.801350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.802192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.803632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.805338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 541/1081] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.810957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.901000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e00cc3a-8b23-412a-93d2-2aa91e8721f7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.903772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279f9e-f95d-4e81-87e6-e81fb6d59293 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:49.932344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.932986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.933266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.933535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.934319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:49.934619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.936065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.936563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:49.937430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:49.937718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:49.937990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72/users/91baa75d95f14c9f905e7abc61194b33/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:49.939938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=304f6c27cca141dda7cda1c9d70f2c72, user_id=91baa75d95f14c9f905e7abc61194b33, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:49.941330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc88e5a-2864-432c-b4e8-59394c531ef4 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:49.947669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 541/1082] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:49.953893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:49.958214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 542/1083] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:49 2022] PUT /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72/users/91baa75d95f14c9f905e7abc61194b33/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:27:50.060764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c78cc3-f518-460e-bc73-1d369046d92c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:50.096671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:50.097566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:50.097838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:50.098105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/7404e3eb672a483fb4e50ddd8e41138b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:50.100395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=0916e52c6c48499588ca68d970588ee7, role_id=7404e3eb672a483fb4e50ddd8e41138b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:50.101828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29632a-623f-43f4-948e-b6ce4f280169 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:50.116821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 542/1084] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:27:49 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/0916e52c6c48499588ca68d970588ee7/roles/7404e3eb672a483fb4e50ddd8e41138b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:27:52.172907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3ed6d-e6ef-496e-a77c-8db6a6e9b823 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.173482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3ed6d-e6ef-496e-a77c-8db6a6e9b823 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.173482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3ed6d-e6ef-496e-a77c-8db6a6e9b823 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.174795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 543/1085] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:52.180783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99d48-48d3-447c-b3e6-b0a8e1dfa3df None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.181255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99d48-48d3-447c-b3e6-b0a8e1dfa3df None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.181346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c99d48-48d3-447c-b3e6-b0a8e1dfa3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.199223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e8c99d48-48d3-447c-b3e6-b0a8e1dfa3df None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:52.201142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e8c99d48-48d3-447c-b3e6-b0a8e1dfa3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:52.278045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 543/1086] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:52.301477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3ed6d-e6ef-496e-a77c-8db6a6e9b823 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.337083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d020ad-6724-4286-889b-4879c2b5ba08 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.337378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d020ad-6724-4286-889b-4879c2b5ba08 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.337656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d020ad-6724-4286-889b-4879c2b5ba08 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.339166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 544/1087] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:52.344301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.344590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.344865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.362529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:52.363750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:52.405630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3ed6d-e6ef-496e-a77c-8db6a6e9b823 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.429451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 545/1088] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:52.438453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.439249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.439561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.439832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.450102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:52.452496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:52.457541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:52.458502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:27:52.459355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:27:52.460038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 544/1089] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:52.464554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.546113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa5315d-20a4-4d94-8579-629506c221be None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.559000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd3858-43c5-4088-8a1f-babe16f83a1d None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.579582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.580375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.580649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.580913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.591144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:27:52.593111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.593770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.594036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.594318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.595048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:52.595352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:52.596869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:27:52.599156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:52.600187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:52.601039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 546/1090] 10.222.0.23 () {56 vars in 1120 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:52.605229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 545/1091] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:52.606534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.610668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.697454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c18ef-74f6-4575-85e5-f8d726a7c1be None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.706794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec9a61-4691-492e-a46e-d62e2a8cda4b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.731877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.732527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.732802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.733071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.733781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:52.734080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:52.735439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:52.739678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.740547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.740824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.741091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] PATH_INFO: `/v3/users/91baa75d95f14c9f905e7abc61194b33` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.742278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] RBAC: Authorizing `identity:get_user(user_id=91baa75d95f14c9f905e7abc61194b33)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:52.743180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 547/1092] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:52.743736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:52.745435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 546/1093] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/users/91baa75d95f14c9f905e7abc61194b33 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:52.748836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.750682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.843521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2ff4c-bc57-4130-8476-f23434ae7d61 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.843851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1be5b-0b07-47ec-a5a2-5fa6738d9cb2 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:52.875542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.876340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.876618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.876888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.877208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a402c91-645c-4931-a147-af6859217147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:52.877837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402c91-645c-4931-a147-af6859217147 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:52.878111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402c91-645c-4931-a147-af6859217147 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:52.878375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a402c91-645c-4931-a147-af6859217147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:52.887588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:52.889053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:52.905623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:52.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:52.907507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:52.907507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:52.907507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:52.907507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:52.907507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 548/1094] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:27:52.912633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:52.944101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a402c91-645c-4931-a147-af6859217147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:52.945541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a402c91-645c-4931-a147-af6859217147 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.009551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf1b63-14cb-4cea-97c0-85bbf66d7d7f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.043983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 547/1095] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:27:53.047652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.048313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.048591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.048860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.049579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:53.049724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a402c91-645c-4931-a147-af6859217147 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.049862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.051249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.063454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 549/1096] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:53.068824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.148292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a402c91-645c-4931-a147-af6859217147 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.168168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcdcf4-31e5-452c-9fca-5ac38e732b95 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.183061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.183948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.184227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.184458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.185714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.187139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.188990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 548/1097] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:53.194991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.200694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.201479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.201757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.202027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.208889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.210305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:27:53.224385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:53.225541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 04 21:27:53.226560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:53.230235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 550/1098] 10.222.0.23 () {56 vars in 1093 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:53.231069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.294882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e605-dc10-4e36-a185-577ab559a0a0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.326402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.327019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.327289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.327578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.328400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=304f6c27cca141dda7cda1c9d70f2c72, user.id=91baa75d95f14c9f905e7abc61194b33) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:53.328706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.329841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b7c70-788d-45a1-bdf9-6def9b6c999e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.330131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.335918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 549/1099] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/role_assignments?user.id=91baa75d95f14c9f905e7abc61194b33&scope.project.id=304f6c27cca141dda7cda1c9d70f2c72&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:53.366539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.367234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.367550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.367862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.368727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:53.369033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.370495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.389742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 551/1100] 10.222.0.23 () {56 vars in 1133 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:27:53.395915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.500503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d47926-2175-4a1c-b7a4-1b4acf5e2e00 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.536710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.537492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.537853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.538152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.606660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.608124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.701821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 550/1101] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:53.707701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.806852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a814c-5e37-46d2-bb07-5f440dd3856e None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:53.841388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:53.842173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:53.842451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:53.842725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:53.855671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:53.857172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:27:53.874988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:53.875990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:53.876884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:27:53.876884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:27:53.876884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:27:53.876884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:53.876884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 552/1102] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:53.882033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:53.984030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547581f-e45b-47a5-8d4c-516946002280 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:54.017766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:54.018424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:54.018699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:54.018970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:54.019733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:54.020037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:54.021406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:54.032781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 551/1103] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:54.038488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:54.139756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef4a16-6bad-497d-8f59-ee196e910eca None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:54.173683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:54.174472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:54.174745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:54.175023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:54.184632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:54.186080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:27:54.200133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:27:54.201597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:27:54.202509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 553/1104] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:27:54.207309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:54.309528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee90c6-abce-4551-81d6-034e6978e39f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:54.343261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:54.344013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:54.344287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:54.344566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:54.345353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:54.345656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:54.347082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f49812-19d0-4090-8a5f-6439b2914e77 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:54.359580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 552/1105] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:27:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:54.365441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:54.465075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7b001-6015-499e-bf71-e23cb3c157f8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:54.500733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:54.501387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:54.501667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:54.501940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:54.502778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] RBAC: Adding query filter params (role.id=7404e3eb672a483fb4e50ddd8e41138b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=0916e52c6c48499588ca68d970588ee7) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:54.503091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:54.504583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73926790-4068-4cbc-bb03-bef9462afd7a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:54.510582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 554/1106] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:54 2022] GET /identity/v3/role_assignments?user.id=0916e52c6c48499588ca68d970588ee7&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=7404e3eb672a483fb4e50ddd8e41138b => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:55.589016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707c5-fe9d-4ad4-87b3-1b76d14fc1b5 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:55.589838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707c5-fe9d-4ad4-87b3-1b76d14fc1b5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:55.589838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707c5-fe9d-4ad4-87b3-1b76d14fc1b5 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:55.592388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 553/1107] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:55.598671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:55.599455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:55.599611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:55.618623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:55.619851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:55.690709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 555/1108] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:55.717530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5707c5-fe9d-4ad4-87b3-1b76d14fc1b5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:55.825523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5707c5-fe9d-4ad4-87b3-1b76d14fc1b5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:55.859638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:55.860347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:55.860622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:55.860877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:55.862053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:55.863508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608515d-19b9-4b66-9061-c8b4f79d1c88 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:55.865136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 554/1109] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:27:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:55.874288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:55.972184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29012d1-19f8-4143-bf98-99c5388d4d1c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:56.005623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:56.006271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:56.006546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:56.006810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:56.007533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:56.008970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01a232-8de6-430b-9bda-3439bc691d77 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:56.031296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 556/1110] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:27:55 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:27:58.276246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8327b5-ff53-4b42-b74c-d045366f66a7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:58.276724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8327b5-ff53-4b42-b74c-d045366f66a7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:58.276828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8327b5-ff53-4b42-b74c-d045366f66a7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:58.278163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 555/1111] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:27:58.283623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:58.284059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:58.284150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:58.302455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:27:58.303663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:27:58.373513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 557/1112] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:27:58.397265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8327b5-ff53-4b42-b74c-d045366f66a7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:58.513082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8327b5-ff53-4b42-b74c-d045366f66a7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:58.549920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:58.551165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:58.551594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:58.551965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] PATH_INFO: `/v3/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:58.554526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] RBAC: Authorizing `identity:get_role(role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:58.556703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:58.558761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 556/1113] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:27:58 2022] GET /identity/v3/roles/3f129043517b4e948ef87a9befee7394 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:58.564642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:58.661835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593368e2-cecf-4805-ad0c-67eb1690232f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:58.695783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:58.696632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:58.696913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:58.697188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] PATH_INFO: `/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:58.710531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] RBAC: Authorizing `identity:get_user(user_id=2e91ab6d7bf94969853dd91f6ee8f2bb)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:58.712028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:58.713653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 558/1114] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:27:58 2022] GET /identity/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:58.719834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:58.830783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb97fd2-6b5a-4039-8370-6cf9debfe57b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:58.864708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:58.865376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:58.865653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:58.865926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:58.931338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:58.932812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:59.052616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 557/1115] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:27:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:27:59.060838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:59.171871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf72b4-0e75-4b60-86c4-c3ce3f91b44a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:59.206213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:59.207075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:59.207352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:59.207661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:59.208964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:59.210400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c3f272-9c6c-456f-a179-9dda7a87eb62 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:59.212204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 559/1116] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:27:59 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:27:59.219363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:27:59.325148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f53353-c314-47eb-bc8e-ee121649bdcd None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:27:59.359862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:27:59.360508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:27:59.360778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:27:59.361043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:27:59.361873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=304f6c27cca141dda7cda1c9d70f2c72, user.id=2e91ab6d7bf94969853dd91f6ee8f2bb) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:27:59.362175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:27:59.363749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bce4e8-23e1-4cfe-b174-851740b09477 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:27:59.370106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 558/1117] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:27:59 2022] GET /identity/v3/role_assignments?user.id=2e91ab6d7bf94969853dd91f6ee8f2bb&scope.project.id=304f6c27cca141dda7cda1c9d70f2c72&role.id=3f129043517b4e948ef87a9befee7394 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:01.563188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dcf0-5944-451a-9d80-aa8b0a6b48b1 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:01.563747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dcf0-5944-451a-9d80-aa8b0a6b48b1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:01.563747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a3dcf0-5944-451a-9d80-aa8b0a6b48b1 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:01.565055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 560/1118] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:01.571675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:01.572126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:01.572227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:01.600175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:01.602105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:01.674085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 559/1119] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:01.705034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3dcf0-5944-451a-9d80-aa8b0a6b48b1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:01.811326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a3dcf0-5944-451a-9d80-aa8b0a6b48b1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:01.847194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:01.848060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:01.848331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:01.848599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] PATH_INFO: `/v3/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:01.850249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] RBAC: Authorizing `identity:get_role(role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:01.851641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:01.853064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 561/1120] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:01 2022] GET /identity/v3/roles/3f129043517b4e948ef87a9befee7394 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:01.859038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:01.962634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7158c7-a64f-4f80-a1d6-94feb52ef98e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:02.001643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:02.002507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:02.002781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:02.003051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] PATH_INFO: `/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:02.004397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=2e91ab6d7bf94969853dd91f6ee8f2bb)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:02.005818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:02.007409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 560/1121] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:01 2022] GET /identity/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:02.013565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:02.110911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8e887-e38a-41bd-b979-c2494de9a0d6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:02.143995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:02.144824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:02.145094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:02.145353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:02.146636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:02.148062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102362bf-1404-40b7-9152-4d1912036010 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:02.149787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 562/1122] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:02 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:02.155951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:02.256975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a240b-9344-4fa7-ae40-6dc2c098d6a9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:02.291028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:02.291919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:02.292191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:02.292460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72/users/2e91ab6d7bf94969853dd91f6ee8f2bb/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:02.295070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] RBAC: Authorizing `identity:create_grant(project_id=304f6c27cca141dda7cda1c9d70f2c72, user_id=2e91ab6d7bf94969853dd91f6ee8f2bb, role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:02.296525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b8fb4-bfd0-415d-a666-25a27486b829 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:02.317071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 561/1123] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:28:02 2022] PUT /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72/users/2e91ab6d7bf94969853dd91f6ee8f2bb/roles/3f129043517b4e948ef87a9befee7394 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:28:04.504507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118b6f-35bb-491b-8cd2-8da9b95a8ff5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:04.505384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118b6f-35bb-491b-8cd2-8da9b95a8ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:04.505384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118b6f-35bb-491b-8cd2-8da9b95a8ff5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:04.507687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 563/1124] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:04.513056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:04.513496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:04.513599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:04.531423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:04.532604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:04.608085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 562/1125] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:04.632120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118b6f-35bb-491b-8cd2-8da9b95a8ff5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:04.751149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118b6f-35bb-491b-8cd2-8da9b95a8ff5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:04.784610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:04.785380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:04.785658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:04.785926 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] PATH_INFO: `/v3/roles/3f129043517b4e948ef87a9befee7394` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:04.787418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] RBAC: Authorizing `identity:get_role(role_id=3f129043517b4e948ef87a9befee7394)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:04.788795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:04.790232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 564/1126] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:04 2022] GET /identity/v3/roles/3f129043517b4e948ef87a9befee7394 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:04.799499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:04.912691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a952d4-4e74-45c1-9e0b-9936fa1dd4e4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:04.946297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:04.947153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:04.947422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:04.947720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] PATH_INFO: `/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:04.949009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] RBAC: Authorizing `identity:get_user(user_id=2e91ab6d7bf94969853dd91f6ee8f2bb)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:04.950435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:04.952088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 563/1127] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:04 2022] GET /identity/v3/users/2e91ab6d7bf94969853dd91f6ee8f2bb => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:04.958239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:05.067360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ffb9d-68d3-4ea2-a755-b9f499371a08 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:05.101213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:05.101894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:05.102170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:05.102442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:05.167312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:05.168765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:05.284981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 565/1128] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:05.291238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:05.393020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4121b0-4b66-4a26-bba3-e0bc024615d1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:05.426160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:05.426988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:05.427259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:05.427551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] PATH_INFO: `/v3/projects/304f6c27cca141dda7cda1c9d70f2c72` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:05.428835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] RBAC: Authorizing `identity:get_project(project_id=304f6c27cca141dda7cda1c9d70f2c72)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:05.430279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5e895-c492-4250-9d06-0b145c55fd94 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:05.431948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 564/1129] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:05 2022] GET /identity/v3/projects/304f6c27cca141dda7cda1c9d70f2c72 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:05.438804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:05.536136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39830b2-f309-42f4-803f-377e9db713be None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:05.570720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:05.571346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:05.571655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:05.571922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:05.572745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] RBAC: Adding query filter params (role.id=3f129043517b4e948ef87a9befee7394, scope.project.id=304f6c27cca141dda7cda1c9d70f2c72, user.id=2e91ab6d7bf94969853dd91f6ee8f2bb) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:05.573050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:05.574467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81a51d-df18-42bc-91a3-0c99efe83372 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:05.580256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 566/1130] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:28:05 2022] GET /identity/v3/role_assignments?user.id=2e91ab6d7bf94969853dd91f6ee8f2bb&scope.project.id=304f6c27cca141dda7cda1c9d70f2c72&role.id=3f129043517b4e948ef87a9befee7394 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:07.816416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf334e3-6cbd-45f5-b845-ed05300db415 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:07.816996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf334e3-6cbd-45f5-b845-ed05300db415 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:07.816996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf334e3-6cbd-45f5-b845-ed05300db415 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:07.819059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 565/1131] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:07.825080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:07.825542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:07.825649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:07.844082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:07.845241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:07.912964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 567/1132] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:28:07.943051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf334e3-6cbd-45f5-b845-ed05300db415 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:08.049797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf334e3-6cbd-45f5-b845-ed05300db415 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:08.083347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:08.084156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:08.084432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:08.084697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:08.085950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:08.087403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971c76e-3be4-47a1-9f42-43690eef85a1 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:08.088982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 566/1133] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:28:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:08.095323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:08.201239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea411ed0-764d-4536-9221-dcaf9e12d317 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:08.236993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:08.237635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:08.237910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:08.238180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:08.238872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:08.240315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb114e57-64a1-4dc4-b271-0c8556793e9f None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:08.269672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 568/1134] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:28:08 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:28:10.515826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79425-aa8f-41be-8ca7-74755a3b6547 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:10.516366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79425-aa8f-41be-8ca7-74755a3b6547 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:10.516366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d79425-aa8f-41be-8ca7-74755a3b6547 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:10.517646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 567/1135] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:10.523987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:10.524664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:10.524841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:10.547791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:10.548970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:10.615130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 569/1136] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:10.646853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79425-aa8f-41be-8ca7-74755a3b6547 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:10.751487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d79425-aa8f-41be-8ca7-74755a3b6547 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:10.784802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:10.785506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:10.785781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:10.786053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:10.787223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:10.788764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82188a67-32a9-4ce3-885d-6740e8960475 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:10.790348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 568/1137] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:28:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:10.799469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:10.911430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01565cce-bbe2-4c7f-be3c-10fe1ca26f96 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:10.945315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:10.945970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:10.946254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:10.946527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:10.947232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:10.948690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc5f63-3a9b-45b9-8654-5b70c6198813 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:10.970899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 570/1138] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:28:10 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:28:13.225053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9680d7-5b07-4a1a-99a7-08cf946e6844 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.225648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9680d7-5b07-4a1a-99a7-08cf946e6844 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.225648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9680d7-5b07-4a1a-99a7-08cf946e6844 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:13.227004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 569/1139] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:13.233505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.234190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.234544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:13.255523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:13.257004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:13.331684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 571/1140] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:13.356588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9680d7-5b07-4a1a-99a7-08cf946e6844 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:13.459974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9680d7-5b07-4a1a-99a7-08cf946e6844 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:13.494257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:13.494958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.495231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.495520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:13.506139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:13.513617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:13.514710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:13.516093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 570/1141] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:13.524177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:13.628322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2322e-3017-49e1-9cc0-e3bb0159390d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:13.662295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:13.662943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.663223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.663604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:13.664306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:13.664606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:13.665970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:13.673805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 572/1142] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:13.680262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:13.800522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74221143-1a64-4ae2-8bb8-d657985cfc58 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:13.833654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:13.834492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.834764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.835028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] PATH_INFO: `/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:13.849166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ff7ffa47d6411b9368a58a4480aa6e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:13.850581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:13.852289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 571/1143] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:13 2022] GET /identity/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:13.858025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:13.956682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c67639-0e65-4d56-8906-1f8cdda213c5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:13.989981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:13.990602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:13.990879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:13.991152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:14.056143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:14.057493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:14.164973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 573/1144] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:14.171035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:14.275790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc0ae7-4155-478f-bf57-dc41dfea06e2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:14.309607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:14.310389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:14.310662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:14.310904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] PATH_INFO: `/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:14.312211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] RBAC: Authorizing `identity:get_project(project_id=44b6ed977f4b473fba5b90f8c9a7592b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:14.313698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb534018-d114-4f80-b852-f8a6aa08f961 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:14.315300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 572/1145] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:14 2022] GET /identity/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:14.323319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:14.424653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f047c-e59a-4ae1-ae89-5880340a7955 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:14.458377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:14.459010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:14.459283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:14.459587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:14.460432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=44b6ed977f4b473fba5b90f8c9a7592b, user.id=e2ff7ffa47d6411b9368a58a4480aa6e) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:14.460732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:14.462142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34275116-7c2c-44d0-8750-8b0ca2a903f9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:14.467921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 574/1146] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:28:14 2022] GET /identity/v3/role_assignments?user.id=e2ff7ffa47d6411b9368a58a4480aa6e&scope.project.id=44b6ed977f4b473fba5b90f8c9a7592b&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:16.730102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445204-7652-47e6-9433-83bbadfe98de None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:16.731007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445204-7652-47e6-9433-83bbadfe98de None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:16.731007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11445204-7652-47e6-9433-83bbadfe98de None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:16.733190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 573/1147] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:16.739439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:16.740108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:16.740343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:16.763772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:16.764942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:16.828600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 575/1148] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:16.851425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445204-7652-47e6-9433-83bbadfe98de None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:16.967344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11445204-7652-47e6-9433-83bbadfe98de None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:17.001315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:17.002020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:17.002291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:17.002559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:17.013148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:17.020622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:17.021703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:17.022848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 574/1149] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:17.028122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:17.126801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ec47-4dea-4df3-8a5c-da21216eb1c7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:17.160024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:17.160676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:17.160954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:17.161223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:17.161965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:17.162267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:17.163678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:17.171397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 576/1150] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:17.177704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:17.295093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1eb94-30d9-4457-8eb5-63fc53f55804 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:17.329811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:17.330669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:17.330942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:17.331219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] PATH_INFO: `/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:17.332524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] RBAC: Authorizing `identity:get_user(user_id=e2ff7ffa47d6411b9368a58a4480aa6e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:17.333941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:17.335596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 575/1151] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:17 2022] GET /identity/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:17.342839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:17.444964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b206e4e-ba2d-4523-abc7-5678c70b2275 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:17.478110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:17.478946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:17.479218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:17.479517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] PATH_INFO: `/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:17.480719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] RBAC: Authorizing `identity:get_project(project_id=44b6ed977f4b473fba5b90f8c9a7592b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:17.482133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b8e4d-920d-4763-882d-f1dd97afe2be None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:17.483807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 577/1152] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:17 2022] GET /identity/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:17.493462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:17.603202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce4fe7-7517-4a63-b204-46213e3da4dc None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:17.636274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:17.637135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:17.637401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:17.637669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] PATH_INFO: `/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b/users/e2ff7ffa47d6411b9368a58a4480aa6e/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:17.639860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=44b6ed977f4b473fba5b90f8c9a7592b, user_id=e2ff7ffa47d6411b9368a58a4480aa6e, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:17.641276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512742a-7ebb-4d99-a5ab-c95ad07e44f0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:17.656877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 576/1153] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:28:17 2022] PUT /identity/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b/users/e2ff7ffa47d6411b9368a58a4480aa6e/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:28:19.847272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822af8-e066-4346-87ed-c81f732da4f4 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:19.848177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822af8-e066-4346-87ed-c81f732da4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:19.848177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22822af8-e066-4346-87ed-c81f732da4f4 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:19.850825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 578/1154] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:19.857582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:19.858033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:19.858179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:19.883395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:19.884591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:19.961160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 577/1155] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:28:19.997049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22822af8-e066-4346-87ed-c81f732da4f4 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:20.101148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22822af8-e066-4346-87ed-c81f732da4f4 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:20.134016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:20.134789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:20.135067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:20.135328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:20.146231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:20.153689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:20.154771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:28:20.155799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 579/1156] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:20.160756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:20.279853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfaa64-807b-48c4-9cb9-275713c64def None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:20.316547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:20.317208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:20.317487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:20.317758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:20.318502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:20.318801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:20.320329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:20.329007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 578/1157] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:20.335339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:20.433387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5e20-2cd2-41bb-9444-36707899094a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:20.474696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:20.475663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:20.475940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:20.476210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] PATH_INFO: `/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:20.477539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=e2ff7ffa47d6411b9368a58a4480aa6e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:20.478967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:20.480628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 580/1158] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:20 2022] GET /identity/v3/users/e2ff7ffa47d6411b9368a58a4480aa6e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:20.486890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:20.591842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158e2b7-c5f9-4d1d-830c-21a650e266eb None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:20.626107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:20.626733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:20.627007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:20.627276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:20.734097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:20.736299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:20.838410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 579/1159] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:20.845083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:20.941019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f7d8e-0f69-4efd-97c0-92ac481a7bf8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:20.974645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:20.975527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:20.975802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:20.976066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] PATH_INFO: `/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:20.977356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] RBAC: Authorizing `identity:get_project(project_id=44b6ed977f4b473fba5b90f8c9a7592b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:20.978774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c71c3e-8e87-4938-9c4d-9879f5095896 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:20.980460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 581/1160] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:20 2022] GET /identity/v3/projects/44b6ed977f4b473fba5b90f8c9a7592b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:20.986880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:21.085375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd49a1-ddc7-47e9-bf8f-d86698ff0979 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:21.119612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:21.120242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:21.120522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:21.120787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:21.121613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=44b6ed977f4b473fba5b90f8c9a7592b, user.id=e2ff7ffa47d6411b9368a58a4480aa6e) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:21.121921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:21.123346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b2000-d5d8-499f-aa77-7f62a464bc63 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:21.129219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 580/1161] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:28:20 2022] GET /identity/v3/role_assignments?user.id=e2ff7ffa47d6411b9368a58a4480aa6e&scope.project.id=44b6ed977f4b473fba5b90f8c9a7592b&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:23.383167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73fdff-b455-43bd-a323-a7de2eae28e0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:23.384060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73fdff-b455-43bd-a323-a7de2eae28e0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:23.384060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73fdff-b455-43bd-a323-a7de2eae28e0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:23.386238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 582/1162] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:23.392437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:23.392889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:23.393007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:23.417888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:23.419068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:23.488044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 581/1163] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:23.517874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73fdff-b455-43bd-a323-a7de2eae28e0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:23.617641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73fdff-b455-43bd-a323-a7de2eae28e0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:23.651203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:23.651889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:23.652163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:23.652431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:23.717484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:23.718902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:23.819426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 583/1164] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:23.825578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:23.930188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b7b83-1eb2-43cc-a20a-4a31c000d8f4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:23.967952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:23.968736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:23.969009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:23.969284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:23.976221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:23.977650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-df4aee67-98b1-472f-b3a7-9b8c726f319d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:23.991809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:23.993016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:23.994080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 582/1165] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:28:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:23.998963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:24.091334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab7b8d-b53f-419c-99da-f21ee0fb355a None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:24.124797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:24.125432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:24.125706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:24.125968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:24.126673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:24.126971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:24.128314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fbe97-0bf8-41ed-8e02-f10a2ad7f99a None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:24.135372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 584/1166] 10.222.0.23 () {56 vars in 1115 bytes} [Wed May 4 21:28:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:26.329343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0b4b-1c81-4712-818f-b94584f8f4b9 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:26.330142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0b4b-1c81-4712-818f-b94584f8f4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:26.330142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d0b4b-1c81-4712-818f-b94584f8f4b9 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:26.332393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 583/1167] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:26.339012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46740b-5d1d-4458-90cf-659f5fa203c7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:26.339791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46740b-5d1d-4458-90cf-659f5fa203c7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:26.339940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46740b-5d1d-4458-90cf-659f5fa203c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:26.360983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ca46740b-5d1d-4458-90cf-659f5fa203c7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:26.362154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ca46740b-5d1d-4458-90cf-659f5fa203c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:26.427750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 585/1168] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:26.457291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d0b4b-1c81-4712-818f-b94584f8f4b9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:26.561392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d0b4b-1c81-4712-818f-b94584f8f4b9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:26.594987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:26.595663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:26.595935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:26.596202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:26.596929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:26.598286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad16eb-b291-4d11-b22e-551cd15fb24e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:26.617102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 584/1169] 10.222.0.23 () {60 vars in 1138 bytes} [Wed May 4 21:28:26 2022] POST /identity/v3/domains => generated 267 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:28:28.826557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebf1b-b561-4df0-9e47-ae4123797f2f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:28.827461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebf1b-b561-4df0-9e47-ae4123797f2f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:28.827461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ebf1b-b561-4df0-9e47-ae4123797f2f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:28.829662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 586/1170] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:28.838086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:28.838492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:28.839013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:28.860797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:28.861996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:28.928959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 585/1171] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:28.955466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebf1b-b561-4df0-9e47-ae4123797f2f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:29.058409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ebf1b-b561-4df0-9e47-ae4123797f2f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:29.092683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:29.093461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:29.093738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:29.094009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] PATH_INFO: `/v3/domains/d9db17f260444362b1564c0dadfffb6f` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:29.104684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9db17f260444362b1564c0dadfffb6f)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:29.106124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9185c2-94fb-43d8-a7df-3ef2b0174af6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:29.107770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 587/1172] 10.222.0.23 () {56 vars in 1183 bytes} [Wed May 4 21:28:28 2022] GET /identity/v3/domains/d9db17f260444362b1564c0dadfffb6f => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:29.116519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:29.217771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55240d5a-2908-4010-9cab-b7ff6a8ef24a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:29.250784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:29.251472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:29.251718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:29.252010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:29.252706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:29.254115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3b59d-e056-4c0e-9e28-96e06f65dcb6 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:29.285755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 586/1173] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:28:29 2022] POST /identity/v3/projects => generated 361 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:28:31.552019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ebcf-d042-4e5f-8010-88b490b04632 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:31.552851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ebcf-d042-4e5f-8010-88b490b04632 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:31.552851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540ebcf-d042-4e5f-8010-88b490b04632 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:31.554962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 588/1174] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:31.561231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:31.561939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:31.562092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:31.582393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:31.583618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:31.651542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 587/1175] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:31.680781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ebcf-d042-4e5f-8010-88b490b04632 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:31.788427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540ebcf-d042-4e5f-8010-88b490b04632 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:31.822131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:31.822912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:31.823152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:31.823571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] PATH_INFO: `/v3/domains/d9db17f260444362b1564c0dadfffb6f` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:31.824781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d9db17f260444362b1564c0dadfffb6f)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:31.826212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27de96-5d98-4d1f-835a-2df80c21af67 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:31.827858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 589/1176] 10.222.0.23 () {56 vars in 1183 bytes} [Wed May 4 21:28:31 2022] GET /identity/v3/domains/d9db17f260444362b1564c0dadfffb6f => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:31.834301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:31.942821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e957c-2249-47d4-a9e3-ace9c3d3e021 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:31.979300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:31.979991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:31.980269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:31.980538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:31.981239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:31.982664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119ecb-1bf4-4823-a652-6a7d2c1998e9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:32.005779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 588/1177] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:28:31 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:28:34.251305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1184a-9b05-4f2f-9c13-ce1da7626d88 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:34.252229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1184a-9b05-4f2f-9c13-ce1da7626d88 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:34.252229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1184a-9b05-4f2f-9c13-ce1da7626d88 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:34.253788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 590/1178] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:34.260925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:34.261342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:34.261431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:34.279213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:34.280415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:34.347325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 589/1179] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:28:34.378048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1184a-9b05-4f2f-9c13-ce1da7626d88 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:34.483165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1184a-9b05-4f2f-9c13-ce1da7626d88 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:34.516802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:34.517518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:34.517806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:34.518081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:34.529827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:34.537400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:34.538506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:28:34.539588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 591/1180] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:34.546978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:34.661742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc6a48-3f0e-4a3e-8593-831ffa2dfbc6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:34.700739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:34.701399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:34.701672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:34.701945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:34.702687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:34.702991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:34.704381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:34.712374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 590/1181] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:34.719266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:34.826591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e8a1-0e5a-48f4-8680-b05378ee4889 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:34.866293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:34.867162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:34.867444 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:34.867741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] PATH_INFO: `/v3/users/f435e50a15674033a5b4e3dd5bb190ab` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:34.881720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] RBAC: Authorizing `identity:get_user(user_id=f435e50a15674033a5b4e3dd5bb190ab)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:34.883172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:34.884912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 592/1182] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:34 2022] GET /identity/v3/users/f435e50a15674033a5b4e3dd5bb190ab => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:34.890931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:34.994717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b1f659-90af-41e3-a9a0-d5e0874baf0b None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:35.027681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:35.028311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:35.028585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:35.028863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:35.100207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:35.101574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:35.208929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 591/1183] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:35.215610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:35.323622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328d9e-7aa8-4de1-a86f-297455119efe None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:35.357830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:35.358615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:35.358886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:35.359246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] PATH_INFO: `/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:35.360579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] RBAC: Authorizing `identity:get_project(project_id=d9d164c4acf84c2494f2e6c09c89f9b7)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:35.362015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd67918-d0e5-433c-a903-291498948f8c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:35.363735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 593/1184] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:35 2022] GET /identity/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:35.376793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:35.481427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d0d62-3eff-4afc-9a90-3ccbc2126d5c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:35.515411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:35.516052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:35.516325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:35.516596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:35.517435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=d9d164c4acf84c2494f2e6c09c89f9b7, user.id=f435e50a15674033a5b4e3dd5bb190ab) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:35.517742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:35.519168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f7347-bd73-490c-adde-7ab33bafb774 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:35.524726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 592/1185] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:28:35 2022] GET /identity/v3/role_assignments?user.id=f435e50a15674033a5b4e3dd5bb190ab&scope.project.id=d9d164c4acf84c2494f2e6c09c89f9b7&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:37.741430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da76c3-3368-45d6-a652-4ef1a503ff9a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:37.742270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da76c3-3368-45d6-a652-4ef1a503ff9a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:37.742270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da76c3-3368-45d6-a652-4ef1a503ff9a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:37.744578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 594/1186] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:37.749962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:37.750406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:37.750508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:37.767693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:37.768845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:37.834051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 593/1187] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:28:37.856664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da76c3-3368-45d6-a652-4ef1a503ff9a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:37.959785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da76c3-3368-45d6-a652-4ef1a503ff9a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:37.993916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:37.994626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:37.994905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:37.995181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:38.005734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:38.013267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:38.014338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:28:38.015213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 595/1188] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:38.022428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:38.118937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1195b78d-12de-4c9e-ae66-6de85539cdaf None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:38.153030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:38.153674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:38.153943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:38.154210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:38.154949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:38.155244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:38.156686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:38.164578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 594/1189] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:38.170757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:38.284305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd153a7-ea2e-4fb7-b7bd-3fcffab7a8c8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:38.318349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:38.319213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:38.319524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:38.319798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] PATH_INFO: `/v3/users/f435e50a15674033a5b4e3dd5bb190ab` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:38.321102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] RBAC: Authorizing `identity:get_user(user_id=f435e50a15674033a5b4e3dd5bb190ab)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:38.322569 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:38.324403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 596/1190] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:38 2022] GET /identity/v3/users/f435e50a15674033a5b4e3dd5bb190ab => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:38.334624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:38.439338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31252f-9db8-4f7f-93d0-266527822ada None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:38.472910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:38.473746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:38.474013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:38.474280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] PATH_INFO: `/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:38.475566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] RBAC: Authorizing `identity:get_project(project_id=d9d164c4acf84c2494f2e6c09c89f9b7)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:38.476982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291904d-cc32-4997-938a-f31cfb537ebc None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:38.478637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 595/1191] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:38 2022] GET /identity/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:38.485266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:38.592721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b06c-3b97-4c7d-b16e-2816131baf57 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:38.625843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:38.626707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:38.626977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:38.627241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] PATH_INFO: `/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7/users/f435e50a15674033a5b4e3dd5bb190ab/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:38.629440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9d164c4acf84c2494f2e6c09c89f9b7, user_id=f435e50a15674033a5b4e3dd5bb190ab, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:38.630871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c972ae-fcec-47fc-90d7-1acf38519531 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:38.649377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 597/1192] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:28:38 2022] PUT /identity/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7/users/f435e50a15674033a5b4e3dd5bb190ab/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:28:40.855048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d95ab-8a67-42c8-b41e-6bac0300f5d0 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:40.855686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d95ab-8a67-42c8-b41e-6bac0300f5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:40.855686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d95ab-8a67-42c8-b41e-6bac0300f5d0 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:40.856963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 596/1193] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:28:40.863059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:40.863803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:40.864015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:40.882423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:28:40.883654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:28:40.951653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 598/1194] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:28:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:28:40.976010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d95ab-8a67-42c8-b41e-6bac0300f5d0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:41.088726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d95ab-8a67-42c8-b41e-6bac0300f5d0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:41.123427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:41.124150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:41.124428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:41.124698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:41.135706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:28:41.143108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:28:41.144241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:28:41.145118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 597/1195] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:28:41.152821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:41.266639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522aba0d-55ee-488f-ace5-59f43a6a318f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:41.300589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:41.301242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:41.301523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:41.301791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:41.302559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:41.302863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:41.304259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:41.312183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 599/1196] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:28:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:41.318326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:41.418538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187af164-bd0d-47d4-8c16-f45a7ea3a0af None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:41.457339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:41.458190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:41.458465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:41.458749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] PATH_INFO: `/v3/users/f435e50a15674033a5b4e3dd5bb190ab` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:41.460066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] RBAC: Authorizing `identity:get_user(user_id=f435e50a15674033a5b4e3dd5bb190ab)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:41.461493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:41.463404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 598/1197] 10.222.0.23 () {56 vars in 1177 bytes} [Wed May 4 21:28:41 2022] GET /identity/v3/users/f435e50a15674033a5b4e3dd5bb190ab => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:28:41.470121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:41.575691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b26e3-2ad5-42ec-bfa9-1d1ce6c106eb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:41.609202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:41.609820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:41.610095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:41.610362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:41.675007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:41.676393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:41.770306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 600/1198] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:28:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:28:41.779962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:41.884872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4410b0c-6076-40d3-a322-ccd3c36f0ada None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:41.918494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:41.919332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:41.919636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:41.919906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] PATH_INFO: `/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:41.921194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] RBAC: Authorizing `identity:get_project(project_id=d9d164c4acf84c2494f2e6c09c89f9b7)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:41.922617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb187d-65de-4b72-8884-121287f44952 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:41.924300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 599/1199] 10.222.0.23 () {56 vars in 1186 bytes} [Wed May 4 21:28:41 2022] GET /identity/v3/projects/d9d164c4acf84c2494f2e6c09c89f9b7 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:28:41.930665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:28:42.035349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab589-3635-4426-9c50-c0354893ee69 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:28:42.068560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:28:42.069185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:28:42.069455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:28:42.069721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:28:42.070531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=d9d164c4acf84c2494f2e6c09c89f9b7, user.id=f435e50a15674033a5b4e3dd5bb190ab) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:28:42.070837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:28:42.072284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b4596-31b9-40e8-b96c-aa54dd6d0cb8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:28:42.078043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 601/1200] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:28:41 2022] GET /identity/v3/role_assignments?user.id=f435e50a15674033a5b4e3dd5bb190ab&scope.project.id=d9d164c4acf84c2494f2e6c09c89f9b7&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:42.545379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845066-b3c8-4e72-98ab-7a8da1e022ce None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:42.545963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845066-b3c8-4e72-98ab-7a8da1e022ce None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:42.545963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845066-b3c8-4e72-98ab-7a8da1e022ce None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:42.547232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 600/1201] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:29:42.552859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:42.553318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:42.553413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:42.572292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:29:42.573494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:29:42.658881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 602/1202] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:29:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:29:42.686819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96845066-b3c8-4e72-98ab-7a8da1e022ce None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:42.808939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96845066-b3c8-4e72-98ab-7a8da1e022ce None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:42.850368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:42.851282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:42.851589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:42.851860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:42.864357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:42.866063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:42.890447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:42.891831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:42.893019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:42.893019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:42.893019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:42.893019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:42.899430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 601/1203] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:42.900738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:43.016167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a45f9-368b-4740-905d-323317c95db9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:43.058845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:43.059618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:43.059820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:43.060121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:43.060839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:43.061123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:43.062501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849bb09-a13c-4e21-9dd7-430d2084e606 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:43.076451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 603/1204] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:43.082338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:43.192336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ddb5d-efbd-4e73-b96d-4bd86ab2c343 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:43.230665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:43.231337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:43.231690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:43.231952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:43.232629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:43.234065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259b7945-323c-4e4d-aea4-d8ea4b347894 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:43.279600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 602/1205] 10.222.0.23 () {60 vars in 1132 bytes} [Wed May 4 21:29:43 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:29:45.645477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd405e9-cfbc-4cd0-9da8-f72b1d02ead2 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:45.646046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd405e9-cfbc-4cd0-9da8-f72b1d02ead2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:45.646046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd405e9-cfbc-4cd0-9da8-f72b1d02ead2 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:45.647740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 604/1206] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:29:45.653378 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf75-a86a-4979-9343-467291550772 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:45.653800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf75-a86a-4979-9343-467291550772 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:45.653907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570bbf75-a86a-4979-9343-467291550772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:45.670727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-570bbf75-a86a-4979-9343-467291550772 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:29:45.671971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-570bbf75-a86a-4979-9343-467291550772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:29:45.743265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 603/1207] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:29:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:29:45.766928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd405e9-cfbc-4cd0-9da8-f72b1d02ead2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:45.872445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd405e9-cfbc-4cd0-9da8-f72b1d02ead2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:45.910683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:45.911420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:45.911706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:45.911974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:45.923575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:29:45.931426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:45.932667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:45.933525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 605/1208] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:29:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:45.939300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbf75-a86a-4979-9343-467291550772 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.052010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570bbf75-a86a-4979-9343-467291550772 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.091418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.092123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.092500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.092760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:46.093636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:46.093945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:46.095544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:46.104365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 604/1209] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:29:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:29:46.110221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.211437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5f855-4c1e-4bf5-89e3-759cfcf7e09c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.249127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.250414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.250414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.250611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:46.261287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:46.263057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:46.280688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:46.281929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:46.282917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:46.282917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:46.282917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:46.282917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:46.286829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 606/1210] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:29:46.288204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.398805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c311a55-4f32-48fc-be6d-e869dbb0245a None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.433164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.434836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.434836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.434836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:46.435205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:46.435676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:46.437189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:46.449847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 605/1211] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:46.456560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.568820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e313d-4024-4fc3-a322-2e2100bad9a1 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.603645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.604737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.605054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.605336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:46.614472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:46.616195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:29:46.632347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:46.638446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:46.639470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 607/1212] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:46.640101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.746699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f9f9d-5fa3-4169-bdf2-7238b9369ee9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.787035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.790113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.790394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.790674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:46.791590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:46.791905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:46.793419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:46.817070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 606/1213] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:29:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:46.823124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:46.949132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f347cf3f-55d4-4251-a539-eb42aef9ef28 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:46.990259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:46.991098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:46.991561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:46.991853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:47.073826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:47.075400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:47.196986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 608/1214] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:29:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:29:47.198488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:47.308266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21869a63-1ed0-471c-a2c0-cc54520fc353 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:47.343297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:47.344076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:47.344383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:47.344703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:47.354649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:47.356132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:47.373294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:47.374439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:47.380199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:47.380199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:47.380199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:47.380199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:47.380199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 607/1215] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:47.380542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:47.491072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028489c2-2ded-4ebd-828c-dd39de8762d7 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:47.531686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:47.531686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:47.531686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:47.533312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:47.533312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:47.533312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:47.534751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:47.546991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 609/1216] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:47.552576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:47.663407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a310-f213-4be1-9f34-a81aaee744ba None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:47.698745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:47.699750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:47.700152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:47.700505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:47.708441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:47.710400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:29:47.726210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:47.727351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:47.728528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:47.734584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 608/1217] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:29:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:47.735867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:47.843654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf3c950-0d7d-46ea-bb3b-28dbde4bf0c9 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:47.880401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:47.881414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:47.881960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:47.882530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:47.883828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:47.884977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:47.885872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048532-ac30-4a34-a2e0-484c2841dcae None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:47.905952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 610/1218] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:29:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:47.907729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:48.022373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4413fc-d308-42a4-a7eb-6f33736299c9 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:48.057429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:48.058207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:48.058514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:48.058786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:48.059670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a4018fbf31d0421d87101f4c771d8017) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:48.060050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:48.061664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16160f-b653-4685-a55c-1b8687771a2e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:48.080913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 609/1219] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:29:47 2022] GET /identity/v3/role_assignments?user.id=a4018fbf31d0421d87101f4c771d8017&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:29:50.357945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50072-e970-4346-bc72-9af24cbd129c None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:50.358537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50072-e970-4346-bc72-9af24cbd129c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:50.358537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c50072-e970-4346-bc72-9af24cbd129c None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:50.360005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 611/1220] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:29:50.365485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:50.365960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:50.366067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:50.383516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:29:50.384722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:29:50.455818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 610/1221] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:29:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:29:50.478999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c50072-e970-4346-bc72-9af24cbd129c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:50.581592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c50072-e970-4346-bc72-9af24cbd129c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:50.615857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:50.616671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:50.616956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:50.617229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:50.627315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:29:50.634987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:50.636362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:50.637466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 612/1222] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:50.644637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:50.747946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b5c8f-06f6-4c6f-a5ab-e91718fe0cfc None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:50.787758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:50.788440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:50.788723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:50.788994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:50.789858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] RBAC: Adding query filter params (name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:50.790201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:50.791669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:50.805132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 611/1223] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:50.806589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:50.928724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2326801-3ed5-4d0b-9ed9-97f780618a7f None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:50.964769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:50.965784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:50.966169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:50.966547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:50.979097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:50.980860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:51.000356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:51.001478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:51.002714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:51.002714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:51.002714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:51.002714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:51.002714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 613/1224] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:51.007598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.107418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befbb7d-739d-4723-902f-4972a9a24394 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:51.143397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:51.144138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:51.144401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:51.144645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:51.145611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:51.145937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:51.147453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.159787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 612/1225] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:51.165593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.277341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11995e-8b86-4a83-bc8d-7e927fca56eb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:51.311481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:51.312297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:51.312714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:51.313013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:51.320951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:51.322414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:29:51.338831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:51.340091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:51.341054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 614/1226] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:29:51.346390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.455207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9954dc6-8d8f-4d3d-8944-f3f72dcde875 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:51.488582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:51.489292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:51.489563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:51.489862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:51.490730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:51.491032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:51.492484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.509947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 613/1227] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:29:51.515740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.620513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a1370-9c1d-4e13-97a7-7ed3aa9762b6 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:51.654580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:51.655405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:51.655674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:51.655943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:51.666675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:51.668223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:51.685324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:51.686465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:51.687404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:51.687404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:51.687404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:51.687404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:51.687404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 615/1228] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:51.693227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.806370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2b4c-e3c8-4756-8eef-b6fbe7cf5e66 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:51.844131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:51.844889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:51.845168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:51.845445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:51.846208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:51.846521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:51.847954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:51.860621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 614/1229] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:51.868427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:51.983763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ca640-36d0-4c52-9f02-d9e4a8f9a866 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:52.020501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:52.021382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:52.021687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:52.021963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:52.029970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:52.031713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:29:52.049934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:52.051623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:52.052642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 616/1230] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:29:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:52.057775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:52.156691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77eccd-09e0-46c3-83f4-2e0f1ae1ea0e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:52.191158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:52.191931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:52.192203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:52.192530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:52.193420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:52.193729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:52.195275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b01f35-88a3-4c7e-b604-94c514c3fb24 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:52.208639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 615/1231] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:29:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:52.215246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:52.325045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd59ae-8938-4efc-879d-e5685aad9e6c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:52.365217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:52.366168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:52.366388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:52.366659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a4018fbf31d0421d87101f4c771d8017/roles/0db257ccddad42c5a91215d615cdec4b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:52.384203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=a4018fbf31d0421d87101f4c771d8017, role_id=0db257ccddad42c5a91215d615cdec4b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:52.385691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8398e39-210b-4bfd-832e-36ddea5da946 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:52.403060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 617/1232] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:29:52 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a4018fbf31d0421d87101f4c771d8017/roles/0db257ccddad42c5a91215d615cdec4b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:29:54.767652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743796-b59a-4b32-965e-3cf2d6147d97 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:54.768282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743796-b59a-4b32-965e-3cf2d6147d97 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:54.768282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32743796-b59a-4b32-965e-3cf2d6147d97 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:54.769676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 616/1233] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:29:54.775183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:54.775646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:54.775803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:54.792448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:29:54.793695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:29:54.863832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 618/1234] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:29:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:29:54.890938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32743796-b59a-4b32-965e-3cf2d6147d97 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.006666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32743796-b59a-4b32-965e-3cf2d6147d97 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.043017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.043784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.044046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.044322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.054482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:29:55.063116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:55.064327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:55.065247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 617/1235] 10.222.0.23 () {56 vars in 1102 bytes} [Wed May 4 21:29:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 04 21:29:55.070855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.170011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aba694-4e7d-4e7b-965e-8847b91bd702 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.203961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.204663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.204930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.205205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.205952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:55.206259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:55.207649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:55.216861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 619/1236] 10.222.0.23 () {56 vars in 1103 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:55.223046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.329509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6471b-d6b9-4684-81f6-e971ff0b9fe8 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.363996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.364795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.365116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.365393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.376184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:55.377644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:55.395357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:55.396675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:55.397764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:55.397764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:55.397764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:55.397764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:55.397764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 618/1237] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:55.402764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.508355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a80d0b-00df-4e61-86b0-aa6c7a5b7b5b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.542557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.543249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.543556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.543827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.544544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:55.544845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:55.546209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:55.558073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 620/1238] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:29:55.565010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.673570 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53978773-ed8e-4375-b726-a93484f05d06 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.710301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.711612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.712049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.712326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.722751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:55.724384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:29:55.739668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:55.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:55.742007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 619/1239] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:55.746943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:55.852816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604ff4b-afe6-4ff4-91b0-adb6dbadc8f8 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:55.893309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:55.894014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:55.894292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:55.894561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:55.896751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:55.897046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:55.898479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:55.924249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 621/1240] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:55.930261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:56.037975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40fb8a1-f026-4309-aacb-7b3eb731b60e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:56.072074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:56.072961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:56.073246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:56.073516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:56.146281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:56.147907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:56.260556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 620/1241] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:29:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:29:56.266608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:56.375736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79c416-77a3-4958-ab89-e7d6048a95fc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:56.412557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:56.413358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:56.413642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:56.413932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:56.424810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:56.426251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:29:56.445755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:56.446989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:56.448238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:29:56.448238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:29:56.448238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:29:56.448238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:56.448238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 622/1242] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:56.452760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:56.558275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71ce37-6f0f-48f7-b51a-105b07b34d62 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:56.594232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:56.594936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:56.595218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:56.595543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:56.596355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:56.596701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:56.598165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:56.609914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 621/1243] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:56.615596 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:56.715237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d3e6-1542-48f2-b2a3-496f70ded82b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:56.752787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:56.753655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:56.754769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:56.754769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:56.761293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:56.762721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:29:56.776295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:56.777208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:29:56.778114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 623/1244] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:29:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:56.783646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:56.888123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345edc8-87c8-4afa-8b74-7f22bfc9eb69 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:56.928581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:56.929427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:56.929591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:56.929908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:56.930777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:56.931422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:56.932739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249865a5-7636-42ad-86a2-c3c0d77c7f25 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:56.948300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 622/1245] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:29:56.954632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:57.070170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e857e2-c258-43eb-b5eb-b6be79878537 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:57.106201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:57.106856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:57.107134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:57.107436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:57.108276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] RBAC: Adding query filter params (role.id=0db257ccddad42c5a91215d615cdec4b, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a4018fbf31d0421d87101f4c771d8017) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:29:57.108584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:29:57.110013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f8670-675f-4959-9bb2-cc50a4894ae7 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:29:57.116815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 624/1246] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:29:56 2022] GET /identity/v3/role_assignments?user.id=a4018fbf31d0421d87101f4c771d8017&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=0db257ccddad42c5a91215d615cdec4b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:29:59.564525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03893-210a-49d2-b1a2-0b5f8421cae7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:59.565054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03893-210a-49d2-b1a2-0b5f8421cae7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:59.565054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac03893-210a-49d2-b1a2-0b5f8421cae7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:59.566349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 623/1247] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:29:59.572416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49321-0727-4192-a06f-47db24bc170d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:59.572889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49321-0727-4192-a06f-47db24bc170d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:59.572983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b49321-0727-4192-a06f-47db24bc170d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:59.591575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-38b49321-0727-4192-a06f-47db24bc170d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:29:59.592743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-38b49321-0727-4192-a06f-47db24bc170d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:29:59.667782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 625/1248] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:29:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:29:59.695266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03893-210a-49d2-b1a2-0b5f8421cae7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:59.807373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac03893-210a-49d2-b1a2-0b5f8421cae7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:29:59.846839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:29:59.847631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:29:59.847920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:29:59.848204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:29:59.861569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:29:59.872559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:29:59.873642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:29:59.874494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:29:59.879575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 624/1249] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:29:59.883334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49321-0727-4192-a06f-47db24bc170d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:29:59.997219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b49321-0727-4192-a06f-47db24bc170d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.035887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.036831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.037089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.037335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:00.038130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:00.038597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:00.040348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:00.049445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 626/1250] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:00.056295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:00.167525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d818483-cfd8-4408-a891-d2d519cd4fa1 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.207460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.208258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.208535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.209119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:00.220705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:00.222497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:00.241638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:00.242800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:00.248402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:00.248402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:00.248402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:00.248402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:00.248402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 625/1251] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:00.248807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:00.361247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e515d-a2e7-4041-b1e8-6bef1c63ac92 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.399707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.400368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.400664 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.401094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:00.401824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:00.402093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:00.403648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:00.416994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 627/1252] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:00.422804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:00.523125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f2250-ca9f-4710-a72e-62a803beaa90 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.558670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.559525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.559839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.560106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:00.570259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:00.571737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:30:00.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:00.589517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:00.590754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 626/1253] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:00.595965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:00.704735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882f58-755a-4944-98ea-4b610ac0d9bb None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.740366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.741066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.741345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.741610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:00.742441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:00.742750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:00.744196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:00.761490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 628/1254] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:30:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:00.767920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:00.870310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e4f24-e2ab-45f3-8ef8-8e0f22e3b91e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:00.920632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:00.921562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:00.921959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:00.922229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.007650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.009087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:01.111766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 627/1255] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:30:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 04 21:30:01.118019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:01.223873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e671f4-4fed-437a-a025-88fde5a62754 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:01.264426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:01.265218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:01.265498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:01.265770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.277913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.279829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:01.301165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:01.302138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:01.303052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:01.303052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:01.303052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:01.303052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:01.303052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 629/1256] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:01.309084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:01.422714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9e664-66af-48ee-a0cd-cef6470209c2 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:01.460930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:01.461807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:01.462069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:01.462342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.463214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:01.463580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.465187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:01.477386 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 628/1257] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:30:01.483697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:01.592507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f9efe-b1cd-473e-977d-a2afbfe6a8be None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:01.627942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:01.628756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:01.629040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:01.629311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.636710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.638187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:30:01.653077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:01.654259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:01.655211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 630/1258] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:30:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:01.660821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:01.772018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24738cfc-7345-49bc-83b5-5c5956016da7 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:01.811103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:01.811944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:01.812229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:01.812504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.813308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:01.813615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.815080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee737c61-6eaf-47ca-81c4-c02fa72281c3 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:01.828997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 629/1259] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:30:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:01.835911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:01.956639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e128a-f4b3-4155-bfac-1f106b4b9402 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:01.990887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:01.991626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:01.991878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:01.992149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:01.992977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a4018fbf31d0421d87101f4c771d8017) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:01.993280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:01.994706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745766f0-8d72-4419-a086-db70641bc011 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:02.000747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 631/1260] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:30:01 2022] GET /identity/v3/role_assignments?user.id=a4018fbf31d0421d87101f4c771d8017&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:04.192290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49a9b-75d1-4ad0-a60e-d2703d381143 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.192876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49a9b-75d1-4ad0-a60e-d2703d381143 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.192876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e49a9b-75d1-4ad0-a60e-d2703d381143 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.194193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 630/1261] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:04.200518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.201249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.201397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.221970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:04.223143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:04.298907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 632/1262] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:30:04.321739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e49a9b-75d1-4ad0-a60e-d2703d381143 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:04.426393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e49a9b-75d1-4ad0-a60e-d2703d381143 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:04.466898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:04.467640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.467922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.468188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.478983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:30:04.486542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:04.487667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:04.488660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 631/1263] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:04.495537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:04.591148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14990-79d6-433a-b4e0-93abe3563cf9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:04.624892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:04.625530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.625806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.626078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.626822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:04.627126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:04.628528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:04.636419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 633/1264] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:30:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:04.645086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:04.764425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c03a2-e980-4e69-9e15-044eca17f44e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:04.798976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:04.799781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.800056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.800313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.810675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:04.812201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:04.828809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:04.829775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:04.830928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:04.830928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:04.830928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:04.830928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:04.830928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 632/1265] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:04.836313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:04.940102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165f56e-04ff-4fae-b836-b2bb359ff796 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:04.973204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:04.973856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:04.974129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:04.974400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:04.975114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:04.975424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:04.976786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:04.988344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 634/1266] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:04.994384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.116462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8c813-a3e5-4bd8-aa34-5dd17ca350d0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:05.149168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:05.149951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:05.150221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:05.150485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:05.157881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:05.159305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:30:05.173460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:05.174527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:05.175549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 633/1267] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:05.181131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.289806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c99816-044e-44f5-abb7-66ee597e69de None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:05.323588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:05.324253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:05.324534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:05.324808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:05.325645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:05.325958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:05.327405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:05.348651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 635/1268] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:30:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:05.355127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.462207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5eb5-aa58-4220-a79b-e763220f9a7f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:05.495151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:05.495951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:05.496222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:05.496528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:05.506998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:05.508459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:05.525174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:05.526164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:05.527426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:05.527426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:05.527426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:05.527426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:05.527426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 634/1269] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:05.533279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.641503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fe06b-b728-49c2-8262-8865831d3fee None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:05.674931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:05.675601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:05.675874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:05.676143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:05.676851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:05.677149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:05.678488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:05.689388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 636/1270] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:05.698126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.798430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557f93c-f595-43cf-aee0-fa036e73e250 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:05.834975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:05.835769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:05.836043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:05.836305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:05.843159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:05.844669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:30:05.859798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:05.860854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:05.862023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 635/1271] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:05.867433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:05.975151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34726cf7-647d-4665-8d49-1e3460e0208d None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:06.007923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:06.008563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:06.008839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:06.009099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:06.009870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:06.010175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:06.011622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb50bdf-430c-4445-8892-1dbe8c0769bb None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:06.026385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 637/1272] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:06.036462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:06.145552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8edf80-c8b4-4646-875e-0f11baa09f8f None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:06.181609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:06.182470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:06.182737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:06.183003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] PATH_INFO: `/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a4018fbf31d0421d87101f4c771d8017/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:06.185188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bcaa95cbf24f389fd93a17969df230, user_id=a4018fbf31d0421d87101f4c771d8017, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:06.186697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92e0d-8d60-40a9-98a4-efcef88ec14f None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:06.201667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 636/1273] 10.222.0.23 () {58 vars in 1439 bytes} [Wed May 4 21:30:06 2022] PUT /identity/v3/projects/e3bcaa95cbf24f389fd93a17969df230/users/a4018fbf31d0421d87101f4c771d8017/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:30:08.397975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef18d-566c-4afc-a0b3-2992c47d01f1 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:08.398805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef18d-566c-4afc-a0b3-2992c47d01f1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:08.398805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef18d-566c-4afc-a0b3-2992c47d01f1 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:08.401125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 638/1274] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:08.407472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:08.407957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:08.408074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:08.436129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:08.437533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:08.511066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 637/1275] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 04 21:30:08.542009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef18d-566c-4afc-a0b3-2992c47d01f1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:08.649557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef18d-566c-4afc-a0b3-2992c47d01f1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:08.691320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:08.692506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:08.692879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:08.693210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:08.707404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(role_id) May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 04 21:30:08.715189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:08.716293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:08.717298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 639/1276] 10.222.0.23 () {56 vars in 1096 bytes} [Wed May 4 21:30:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:08.722909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:08.827637 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d46d-f591-4778-8dcf-0255b1d0ae79 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:08.861920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:08.862579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:08.862848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:08.863134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:08.863930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:08.864252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:08.865606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:08.875037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 638/1277] 10.222.0.23 () {56 vars in 1099 bytes} [Wed May 4 21:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:08.882374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:08.990290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f8af5-9798-4881-9d07-5c8c5a51684b None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:09.023509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:09.024288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:09.024558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:09.024821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:09.035351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:09.036807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:09.053416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:09.054437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:09.055530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:09.055530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:09.055530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:09.055530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:09.055530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 640/1278] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:09.060625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:09.163740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d0cf8-e301-4682-8b9d-61ddbb38086c None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:09.197140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:09.197790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:09.198066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:09.198346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:09.199067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:09.199370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:09.200768 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:09.212689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 639/1279] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:30:09.220361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:09.327014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a73a4-7717-4e3a-87be-a09482ceb7d5 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:09.360187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:09.360995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:09.361276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:09.361540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:09.368820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:09.370242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_user(user_id) May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 04 21:30:09.384290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:09.385459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:09.386767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 641/1280] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:09.391663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:09.491642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb9e3f-42d8-40be-ae13-80e54c5b9b3e None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:09.524749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:09.525399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:09.525672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:09.525943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:09.526773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:09.527071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:09.528517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:09.547928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 640/1281] 10.222.0.23 () {56 vars in 1143 bytes} [Wed May 4 21:30:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:09.556651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:09.660252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f588b1-a3d6-4e82-b10f-241b2e5d9acc None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:09.693094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:09.693726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:09.694006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:09.694272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:09.767702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:09.769078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:09.876709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 642/1282] 10.222.0.23 () {58 vars in 1282 bytes} [Wed May 4 21:30:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 04 21:30:09.885622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:09.987573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd1e37-8e25-434e-8199-7cf289d06be0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:10.022927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:10.023663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:10.023937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:10.024205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:10.034541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:10.036031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 04 21:30:10.055747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:10.056763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:10.057666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 04 21:30:10.057666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 04 21:30:10.057666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 04 21:30:10.057666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:10.057666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 641/1283] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:10.063654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:10.174299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df65b12-76bc-4abf-83cc-5d8675fd6a6c None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:10.210271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:10.210916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:10.211198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:10.211504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:10.212223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:10.212529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:10.213884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:10.224930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 643/1284] 10.222.0.23 () {56 vars in 1109 bytes} [Wed May 4 21:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:10.233790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:10.337987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e4798-6121-44b5-92c6-b1e0df96b508 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:10.378454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:10.379243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:10.379547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:10.379822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:10.388435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:10.390111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(project_id) May 04 21:30:10.403941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application with Lock( May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:10.404917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: ERROR keystone.server.flask.application May 04 21:30:10.405960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 642/1285] 10.222.0.23 () {56 vars in 1111 bytes} [Wed May 4 21:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:10.412126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:10.519839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9ee71-f1aa-4377-af49-eb0cc4561955 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:10.558080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:10.558708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:10.559010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:10.559322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:10.560105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:10.560412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:10.561962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abaf7b8-a8b1-4ff2-99ae-3748d6625500 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:10.573863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 644/1286] 10.222.0.23 () {56 vars in 1148 bytes} [Wed May 4 21:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:30:10.584025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:10.686392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c78ee-10ba-46b7-b7fa-60e87fdbf337 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:10.720291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:10.720925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:10.721204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:10.721475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:10.722307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] RBAC: Adding query filter params (role.id=1af302468b924833a9aea028857eac8d, scope.project.id=e3bcaa95cbf24f389fd93a17969df230, user.id=a4018fbf31d0421d87101f4c771d8017) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:10.722621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:10.724084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f45e6-dfd0-4c13-b030-4a8137491fff None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:10.729941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 643/1287] 10.222.0.23 () {56 vars in 1374 bytes} [Wed May 4 21:30:10 2022] GET /identity/v3/role_assignments?user.id=a4018fbf31d0421d87101f4c771d8017&scope.project.id=e3bcaa95cbf24f389fd93a17969df230&role.id=1af302468b924833a9aea028857eac8d => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:12.987455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d922b7e-0009-4183-9096-71cfdfdb7b9f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:12.988051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d922b7e-0009-4183-9096-71cfdfdb7b9f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:12.988051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d922b7e-0009-4183-9096-71cfdfdb7b9f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:12.989382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 645/1288] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:12.996887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:12.997319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:12.997426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:13.014345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:13.015646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:13.086189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 644/1289] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:30:13.112868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d922b7e-0009-4183-9096-71cfdfdb7b9f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:13.222019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d922b7e-0009-4183-9096-71cfdfdb7b9f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:13.256030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:13.257093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:13.257462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:13.257821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:13.258831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:13.260899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:13.274289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:13.275587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:13.276533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 646/1290] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:30:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:13.281684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:13.386085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30458fc-c42d-4b26-b238-8ccc39a801cb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:13.424598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:13.425254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:13.425531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:13.425805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:13.426507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:13.426809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:13.428205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee9774-3bc2-4cdf-813c-d10da1e94e56 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:13.433034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 645/1291] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 21:30:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:13.441829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:13.543645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cd55f-0781-4890-8b05-d69c36565b05 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:13.585630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:13.586567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:13.586954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:13.587313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] PATH_INFO: `/v3/services` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:13.588412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] RBAC: Adding query filter params (type=placement) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:13.588842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:13.591011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c63737-5c4d-47d8-ab64-da3c028412ab None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:13.596342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 647/1292] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 21:30:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:15.810521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe044-8837-42a3-b251-1633c44952fb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:15.811178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe044-8837-42a3-b251-1633c44952fb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:15.811178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7fe044-8837-42a3-b251-1633c44952fb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:15.812539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 646/1293] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:15.818638 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3282-858c-4b81-a7de-8d2be40af0ec None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:15.819359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3282-858c-4b81-a7de-8d2be40af0ec None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:15.819526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d3282-858c-4b81-a7de-8d2be40af0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:15.844954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8d6d3282-858c-4b81-a7de-8d2be40af0ec None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:15.846139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8d6d3282-858c-4b81-a7de-8d2be40af0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:15.925326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 648/1294] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:30:15.948376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe044-8837-42a3-b251-1633c44952fb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:16.049651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7fe044-8837-42a3-b251-1633c44952fb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:16.085785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:16.086421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:16.086693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:16.086958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:16.087698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:16.089072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40d555-125d-4960-aa7b-afa3e62a1639 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:16.110220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 647/1295] 10.222.0.23 () {60 vars in 1141 bytes} [Wed May 4 21:30:15 2022] POST /identity/v3/services => generated 246 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:30:18.336434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40304c7-c4eb-48f8-a6dc-e438741b8d2f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:18.336986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40304c7-c4eb-48f8-a6dc-e438741b8d2f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:18.336986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40304c7-c4eb-48f8-a6dc-e438741b8d2f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:18.338365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 649/1296] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:18.344850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854459-a612-4088-9576-90eef357ae78 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:18.345508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854459-a612-4088-9576-90eef357ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:18.345725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf854459-a612-4088-9576-90eef357ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:18.368377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-cf854459-a612-4088-9576-90eef357ae78 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:18.369537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cf854459-a612-4088-9576-90eef357ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:18.445399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 648/1297] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:18 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:30:18.474709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40304c7-c4eb-48f8-a6dc-e438741b8d2f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:18.577810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40304c7-c4eb-48f8-a6dc-e438741b8d2f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:18.610123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:18.610921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:18.611194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:18.611494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:18.612144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:18.613514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:18.624924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:18.625957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:18.626808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 650/1298] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:30:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:18.632221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf854459-a612-4088-9576-90eef357ae78 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:18.726123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf854459-a612-4088-9576-90eef357ae78 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:18.758050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:18.758705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:18.758983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:18.759341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:18.760071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:18.760380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:18.761742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:18.766756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 649/1299] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 21:30:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:18.773423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:18.882990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be214c2-30ec-4e0d-b37a-93578199be59 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:18.928230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d18206-2996-4977-9cec-2629c821093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:18.929209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18206-2996-4977-9cec-2629c821093c None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:18.929647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18206-2996-4977-9cec-2629c821093c None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:18.930065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d18206-2996-4977-9cec-2629c821093c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:18.931439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18206-2996-4977-9cec-2629c821093c None admin] RBAC: Adding query filter params (interface=public, service_id=11d0e00a006a44918970078d1553f207, region_id=RegionOne) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:18.931896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18206-2996-4977-9cec-2629c821093c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:18.934059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d18206-2996-4977-9cec-2629c821093c None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:18.940160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 651/1300] 10.222.0.23 () {56 vars in 1251 bytes} [Wed May 4 21:30:18 2022] GET /identity/v3/endpoints?service_id=11d0e00a006a44918970078d1553f207&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:18.945938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:19.056295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118633ee-e9c3-4a4f-9ce8-99f9c0db4bf0 None admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:19.090200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:19.090845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:19.091125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:19.091361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:19.092164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:19.093564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89437ae5-c199-4d83-b1d1-68ee113484b0 None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:19.100360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 650/1301] 10.222.0.23 () {56 vars in 1087 bytes} [Wed May 4 21:30:18 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:30:21.304243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401820-b7af-4f6e-ab6d-753b90ca9c64 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:21.305054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401820-b7af-4f6e-ab6d-753b90ca9c64 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:21.305230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53401820-b7af-4f6e-ab6d-753b90ca9c64 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:21.307345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 652/1302] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:30:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:30:21.312652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:21.313072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:21.313181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:21.331049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:30:21.332230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:30:21.398710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 651/1303] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:30:21 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 04 21:30:21.421985 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53401820-b7af-4f6e-ab6d-753b90ca9c64 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:21.538103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53401820-b7af-4f6e-ab6d-753b90ca9c64 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:21.570920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:21.571737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:21.572012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:21.572285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:21.572959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:21.574312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application Traceback (most recent call last): May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 04 21:30:21.586299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._get_service(service_id) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 04 21:30:21.587477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.get_or_create( May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application with Lock( May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self._enter() May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application return self.creator() May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application created_value = creator( May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: ERROR keystone.server.flask.application May 04 21:30:21.588819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 653/1304] 10.222.0.23 () {56 vars in 1117 bytes} [Wed May 4 21:30:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 04 21:30:21.594760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:21.692562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3339d-7ff4-45db-baae-0038af999c88 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:21.726693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:21.727326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:21.727628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:21.727894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] PATH_INFO: `/v3/services` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:21.728588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:30:21.728885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:21.730244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe8909-25e6-4416-91d1-369c8da3753e None admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:21.735360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 652/1305] 10.222.0.23 () {56 vars in 1116 bytes} [Wed May 4 21:30:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:30:21.741755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:30:21.844073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c7343-c79d-49b2-94a1-e152f3f8b986 None admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:30:21.877054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:30:21.877694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:30:21.877974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:30:21.878259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:30:21.878981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:30:21.880367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f523b-eb42-4c5c-b937-0665b7ffff10 None admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:30:21.903610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 654/1306] 10.222.0.23 () {60 vars in 1144 bytes} [Wed May 4 21:30:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:31:25.868785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031e32-8222-401a-9351-11af0408da55 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:25.869958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031e32-8222-401a-9351-11af0408da55 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:25.870334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b031e32-8222-401a-9351-11af0408da55 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:25.872426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 653/1307] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:25.878131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00705ec-0a4d-4df4-b49b-737d744fd29b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:25.878566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00705ec-0a4d-4df4-b49b-737d744fd29b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:25.878566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00705ec-0a4d-4df4-b49b-737d744fd29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:25.969118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a00705ec-0a4d-4df4-b49b-737d744fd29b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:25.970363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a00705ec-0a4d-4df4-b49b-737d744fd29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:26.097666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 655/1308] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:26.147756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:26.148041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:26.148603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:26.150052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 654/1309] 10.222.0.23 () {54 vars in 964 bytes} [Wed May 4 21:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:31:26.156920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8bbc-5914-41f1-a370-4324960cdbb8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:26.157203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8bbc-5914-41f1-a370-4324960cdbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:26.157750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8bbc-5914-41f1-a370-4324960cdbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:26.234320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f06e8bbc-5914-41f1-a370-4324960cdbb8 None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:26.235447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f06e8bbc-5914-41f1-a370-4324960cdbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:26.318146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 656/1310] 10.222.0.23 () {58 vars in 1061 bytes} [Wed May 4 21:31:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:26.327101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:26.329157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:26.437053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a03c6d-dc21-4866-8e8c-e146e756ca79 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:26.510479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:26.511127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:26.511373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:26.511694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:26.513308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:26.620858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:26.622320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04177f-146f-4a9c-a08a-8e377f8d9309 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:26.643426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 655/1311] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:29.155038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:29.155660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:29.155660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:29.159735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 657/1312] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:29.162290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0767-c383-4ff4-bb0c-ae27164034bb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:29.162714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0767-c383-4ff4-bb0c-ae27164034bb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:29.162836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f0767-c383-4ff4-bb0c-ae27164034bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:29.250844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c96f0767-c383-4ff4-bb0c-ae27164034bb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:29.252847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c96f0767-c383-4ff4-bb0c-ae27164034bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:29.367274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 656/1313] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:31:29.405164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:29.406692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:29.520457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486a9b2-dccb-4193-85ec-39053ab7ef25 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:29.602424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:29.603158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:29.603529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:29.603874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:29.605586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:29.718623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:29.720114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e7244-9c4f-4f31-99cb-64e61023da5d service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:29.738314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 658/1314] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:32.301613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7940f-ca9c-402d-bcff-50c4f1592380 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:32.302134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7940f-ca9c-402d-bcff-50c4f1592380 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:32.302134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7940f-ca9c-402d-bcff-50c4f1592380 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:32.303562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 657/1315] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:32.309934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316cd7-b837-4dd0-876c-1e9e32338a8e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:32.310654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316cd7-b837-4dd0-876c-1e9e32338a8e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:32.310852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c316cd7-b837-4dd0-876c-1e9e32338a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:32.377614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1c316cd7-b837-4dd0-876c-1e9e32338a8e None None] MFA Rules not processed for user `20fcf0cba5134cd9abba8606e062329a`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:32.378794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1c316cd7-b837-4dd0-876c-1e9e32338a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:32.481239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 659/1316] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:32.545658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:32.545964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:32.546380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:32.548259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 658/1317] 10.222.0.23 () {54 vars in 964 bytes} [Wed May 4 21:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:32.554875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03fae-f1d7-41a5-8d3f-6107898983aa None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:32.555248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03fae-f1d7-41a5-8d3f-6107898983aa None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:32.555625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc03fae-f1d7-41a5-8d3f-6107898983aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:32.634559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7cc03fae-f1d7-41a5-8d3f-6107898983aa None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:32.635791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7cc03fae-f1d7-41a5-8d3f-6107898983aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:32.715557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 660/1318] 10.222.0.23 () {58 vars in 1061 bytes} [Wed May 4 21:31:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:32.724925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:32.726448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:32.843200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03539d-7a51-45e8-8262-901b416aa244 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:32.926978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:32.927650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:32.927930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:32.928206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:32.929918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:33.037675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:33.039154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bf2ea0-0056-4a7a-bc8b-59169a027262 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:33.056878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 659/1319] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:36.150567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:36.151118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:36.151118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:36.152429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 661/1320] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:36.158672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-ad74-4874-aab3-f6aa7bc29f02 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:36.159443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-ad74-4874-aab3-f6aa7bc29f02 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:36.159615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782ae4-ad74-4874-aab3-f6aa7bc29f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:36.230124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b8782ae4-ad74-4874-aab3-f6aa7bc29f02 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:36.231314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b8782ae4-ad74-4874-aab3-f6aa7bc29f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:36.331067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 660/1321] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:36.373716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:36.376441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:36.486837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e5a66-d850-4309-8838-7a27c0c5d890 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:36.560230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:36.560876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:36.561155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:36.561423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:36.563036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:36.668367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:36.669823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d14f61-fb0b-4b8d-a81f-7a627da9a632 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:36.687734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 662/1322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:39.601335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:39.601881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:39.601881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:39.603268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 661/1323] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:39.608479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4b336-0e16-4027-bc11-ba23c2398225 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:39.608948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4b336-0e16-4027-bc11-ba23c2398225 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:39.609067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4b336-0e16-4027-bc11-ba23c2398225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:39.671567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3da4b336-0e16-4027-bc11-ba23c2398225 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:39.672742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3da4b336-0e16-4027-bc11-ba23c2398225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:39.767845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 663/1324] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:39.803654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:39.805198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:39.910837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b139708-f5c4-4508-a534-3818d1bf0f85 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:39.984504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:39.985146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:39.985423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:39.985688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:39.987289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:40.094177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:40.095764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8079c-712a-4e33-a9c4-bea030e419b9 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:40.115620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 662/1325] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:42.406076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:42.406629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:42.406629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:42.408016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 664/1326] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:42.413273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c98e-fab5-4e5a-856d-138e22c1b2c1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:42.413695 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c98e-fab5-4e5a-856d-138e22c1b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:42.413811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211c98e-fab5-4e5a-856d-138e22c1b2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:42.476686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e211c98e-fab5-4e5a-856d-138e22c1b2c1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:42.477851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e211c98e-fab5-4e5a-856d-138e22c1b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:42.571625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 663/1327] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:42.607291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:42.608904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:42.719712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca910425-3c55-4a9d-b7bb-86735d62e851 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:42.791146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:42.791821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:42.792105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:42.792404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:42.794039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:42.902274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:42.903771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2497200-983a-4f16-90d9-834a1a4ab9e0 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:42.922012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 665/1328] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:45.186792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:45.187355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:45.187355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:45.188766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 664/1329] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:45.194134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6079-18a9-4b55-b1b0-b382b7cbec1e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:45.194558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6079-18a9-4b55-b1b0-b382b7cbec1e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:45.194645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a6079-18a9-4b55-b1b0-b382b7cbec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:45.260108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5d6a6079-18a9-4b55-b1b0-b382b7cbec1e None None] MFA Rules not processed for user `20fcf0cba5134cd9abba8606e062329a`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:45.261352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5d6a6079-18a9-4b55-b1b0-b382b7cbec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:45.363422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 666/1330] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:45.400716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:45.402257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:45.505988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ce415-fea8-4401-a562-550c77396c27 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:45.583291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:45.583966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:45.584233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:45.584608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:45.586322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:45.696531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:45.697958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59f43e-ad7a-4758-b101-818f89936e5d service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:45.716969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 665/1331] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:48.179888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:48.180424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:48.180424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:48.182397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 667/1332] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:48.187664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3510-c474-4f1a-9cfe-19eaebc1f430 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:48.188080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3510-c474-4f1a-9cfe-19eaebc1f430 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:48.188172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d3510-c474-4f1a-9cfe-19eaebc1f430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:48.253037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6d0d3510-c474-4f1a-9cfe-19eaebc1f430 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:48.254201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6d0d3510-c474-4f1a-9cfe-19eaebc1f430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:48.351972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 666/1333] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:48.397751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:48.399262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:48.507118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfde0e-cbf0-48dc-8846-90684ed3cc40 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:48.584732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:48.585403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:48.585683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:48.585956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:48.587832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:48.697248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:48.698583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa878-f730-49a6-8c96-cf96e5aa9e37 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:48.717117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 668/1334] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:50.987375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:50.988297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:50.988297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:50.990584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 667/1335] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:50.995774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633292-98af-48ff-ba3b-b3c667f5836a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:50.996197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633292-98af-48ff-ba3b-b3c667f5836a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:50.996308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95633292-98af-48ff-ba3b-b3c667f5836a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:51.063800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-95633292-98af-48ff-ba3b-b3c667f5836a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:51.065013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-95633292-98af-48ff-ba3b-b3c667f5836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:51.163200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 669/1336] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:51.206225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:51.207762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:51.317331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb34127-ecc9-49d4-9e3e-1e157235448e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:51.395959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:51.396652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:51.396933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:51.397204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:51.398850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:51.515447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:51.517502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c0d33-efe2-4e54-b569-06a87ce559ef service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:51.537769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 668/1337] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:31:54.051826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:54.052665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:54.052665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:54.054895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 670/1338] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:54.062826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22db-2d07-4f63-a8e1-508fe7f28156 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:54.063290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22db-2d07-4f63-a8e1-508fe7f28156 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:54.063402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b22db-2d07-4f63-a8e1-508fe7f28156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:54.131000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-988b22db-2d07-4f63-a8e1-508fe7f28156 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:54.132123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-988b22db-2d07-4f63-a8e1-508fe7f28156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:54.226474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 669/1339] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:31:54.261955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:54.263501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:54.363603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074bc22-43df-4c69-9791-27dc82b724ae None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:54.441441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:54.442033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:54.442310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:54.442577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:54.444242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:54.557235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:54.558668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709117f1-5a73-4b58-bed8-c55ab784c384 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:54.578681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 671/1340] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:31:58.822039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:58.822719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:58.822719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:58.824087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 670/1341] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:31:58.829479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777b807-6d0d-4c64-877c-c4d87af0fd1e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:58.829953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777b807-6d0d-4c64-877c-c4d87af0fd1e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:58.830065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777b807-6d0d-4c64-877c-c4d87af0fd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:58.906168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4777b807-6d0d-4c64-877c-c4d87af0fd1e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:31:58.907711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4777b807-6d0d-4c64-877c-c4d87af0fd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:59.010589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 672/1342] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:31:59.048430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:31:59.050889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:31:59.148845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1cbb00-7870-4b77-b758-c6f7926a3d83 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:31:59.152718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:31:59.153367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:31:59.153646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:31:59.153921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:31:59.163670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:31:59.165114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c1e53d-e50b-4f94-8897-b0c84a7ecdc5 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:31:59.175312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 671/1343] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:02.173155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e35d-1fac-406d-bce4-3d09aa992f25 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:02.174025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e35d-1fac-406d-bce4-3d09aa992f25 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:02.174307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5e35d-1fac-406d-bce4-3d09aa992f25 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:02.175755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 673/1344] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:02.181430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1542-2a71-4274-81f9-1edd24911c65 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:02.181944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1542-2a71-4274-81f9-1edd24911c65 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:02.181944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1542-2a71-4274-81f9-1edd24911c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:02.211372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-dd6d1542-2a71-4274-81f9-1edd24911c65 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:02.212602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-dd6d1542-2a71-4274-81f9-1edd24911c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:02.289964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 672/1345] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:02.327077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5e35d-1fac-406d-bce4-3d09aa992f25 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:02.338395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5e35d-1fac-406d-bce4-3d09aa992f25 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:02.341936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:02.342570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:02.342851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:02.343125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:02.352443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:02.353912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f91fa-f3d6-476a-91ab-1cbaa43b5e08 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:02.363548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 674/1346] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:06.807888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:06.808435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:06.808435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:06.809879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 673/1347] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:06.815041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945709-ca53-4b2f-9bf9-a1e3d94d302f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:06.815586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945709-ca53-4b2f-9bf9-a1e3d94d302f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:06.815586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e945709-ca53-4b2f-9bf9-a1e3d94d302f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:06.833952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6e945709-ca53-4b2f-9bf9-a1e3d94d302f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:06.835150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6e945709-ca53-4b2f-9bf9-a1e3d94d302f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:06.843315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 675/1348] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:06.882510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:06.885206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:06.900180 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04bd25-3782-4323-9f00-57ca0f463062 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:06.904709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:06.905355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:06.905634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:06.905908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:06.916192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:06.917641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d162127-7439-406e-8a5b-de0ab8f47899 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:06.927628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 674/1349] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:12.152776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b046f-16b7-454f-8b83-c7b7da0a13c6 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:12.153283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b046f-16b7-454f-8b83-c7b7da0a13c6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:12.153391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b046f-16b7-454f-8b83-c7b7da0a13c6 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:12.155014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 676/1350] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:12.160505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d77c8-d8d1-4297-8275-1a4e179a2cf4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:12.160967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d77c8-d8d1-4297-8275-1a4e179a2cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:12.161060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d77c8-d8d1-4297-8275-1a4e179a2cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:12.251998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-091d77c8-d8d1-4297-8275-1a4e179a2cf4 None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:12.253717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-091d77c8-d8d1-4297-8275-1a4e179a2cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:12.367028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 675/1351] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:32:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:16.532286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8faa-67fa-4617-b041-b7b16b1dbde1 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.532812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8faa-67fa-4617-b041-b7b16b1dbde1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.532812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd8faa-67fa-4617-b041-b7b16b1dbde1 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.534080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 677/1352] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:16.539226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafced-3eda-4079-b9d8-a025d95fe92e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:16.539692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafced-3eda-4079-b9d8-a025d95fe92e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:16.539920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafced-3eda-4079-b9d8-a025d95fe92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:16.558777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-bdaafced-3eda-4079-b9d8-a025d95fe92e None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:16.560107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bdaafced-3eda-4079-b9d8-a025d95fe92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:16.568908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 676/1353] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:32:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:17.977329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6fad-817c-4ce9-8952-95cedc82d6bd None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:17.978411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6fad-817c-4ce9-8952-95cedc82d6bd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:17.978848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6fad-817c-4ce9-8952-95cedc82d6bd None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:17.980325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 678/1354] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:17.985660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28ede-4543-4893-b64f-e6ca54376b00 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:17.986064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28ede-4543-4893-b64f-e6ca54376b00 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:17.986223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad28ede-4543-4893-b64f-e6ca54376b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:18.005546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-dad28ede-4543-4893-b64f-e6ca54376b00 None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:18.006726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-dad28ede-4543-4893-b64f-e6ca54376b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:18.016025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 677/1355] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:32:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:21.936601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160a6f-31fe-4a53-a65a-775769403981 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.937144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160a6f-31fe-4a53-a65a-775769403981 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.937144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60160a6f-31fe-4a53-a65a-775769403981 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.938583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 679/1356] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:21.943745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8be66-66b2-44d4-a3d2-c542a8d1ba49 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:21.944154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8be66-66b2-44d4-a3d2-c542a8d1ba49 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:21.944259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8be66-66b2-44d4-a3d2-c542a8d1ba49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:21.963033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e8d8be66-66b2-44d4-a3d2-c542a8d1ba49 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:21.964245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e8d8be66-66b2-44d4-a3d2-c542a8d1ba49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:21.972672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 678/1357] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:22.021057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70fd80-2cc0-45cf-b866-9c63a92ae232 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:22.021452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70fd80-2cc0-45cf-b866-9c63a92ae232 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:22.021822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70fd80-2cc0-45cf-b866-9c63a92ae232 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:22.023348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 680/1358] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:22.028925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144214d-2c41-4613-a4ed-d8e94d12fd23 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:22.029208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144214d-2c41-4613-a4ed-d8e94d12fd23 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:22.029696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144214d-2c41-4613-a4ed-d8e94d12fd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:22.079980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c144214d-2c41-4613-a4ed-d8e94d12fd23 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:22.081612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c144214d-2c41-4613-a4ed-d8e94d12fd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:22.169977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 679/1359] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:32:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:22.177358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70fd80-2cc0-45cf-b866-9c63a92ae232 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:22.191940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70fd80-2cc0-45cf-b866-9c63a92ae232 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:22.197938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:22.198690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:22.199050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:22.199441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:22.208949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:22.210815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372cc5e-b1b8-4d13-80fd-346f547ce38b service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:22.221231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 681/1360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:32:24.657542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bdc1c-5724-4f5a-85c0-feeeb1bcd48d None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:24.658394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bdc1c-5724-4f5a-85c0-feeeb1bcd48d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:24.658818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bdc1c-5724-4f5a-85c0-feeeb1bcd48d None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:24.663742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 680/1361] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:24.665801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120150a-e5e7-48b9-a618-6bb8b5dbe156 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:24.666575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120150a-e5e7-48b9-a618-6bb8b5dbe156 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:24.667000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b120150a-e5e7-48b9-a618-6bb8b5dbe156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:24.685085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b120150a-e5e7-48b9-a618-6bb8b5dbe156 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:24.686484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b120150a-e5e7-48b9-a618-6bb8b5dbe156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:24.696768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 682/1362] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:24.740409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bdc1c-5724-4f5a-85c0-feeeb1bcd48d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:24.761239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bdc1c-5724-4f5a-85c0-feeeb1bcd48d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:24.770793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:24.771518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:24.773464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:24.774664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:24.788169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:24.789765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b34ad-e5f6-4f0a-9a52-7076fc41b019 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:24.816107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 681/1363] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:27.365914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cd64-e8bc-4b01-b00b-3097df728156 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.366421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cd64-e8bc-4b01-b00b-3097df728156 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.366524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98cd64-e8bc-4b01-b00b-3097df728156 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.367883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 683/1364] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:27.381170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5de04-6f0c-4345-a5fd-c4eb09145df0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.381629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5de04-6f0c-4345-a5fd-c4eb09145df0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.381752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5de04-6f0c-4345-a5fd-c4eb09145df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.400362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f7e5de04-6f0c-4345-a5fd-c4eb09145df0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:27.401613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f7e5de04-6f0c-4345-a5fd-c4eb09145df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:27.410225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 682/1365] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:27.456095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a105ac-8c9b-47fd-adbf-baff3291e262 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.456446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a105ac-8c9b-47fd-adbf-baff3291e262 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.456700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a105ac-8c9b-47fd-adbf-baff3291e262 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.458414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 684/1366] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:27.469301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf918b4-5dbc-4bf9-982b-52c796457f52 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.469585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf918b4-5dbc-4bf9-982b-52c796457f52 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.469860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf918b4-5dbc-4bf9-982b-52c796457f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.494104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-abf918b4-5dbc-4bf9-982b-52c796457f52 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:27.495304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-abf918b4-5dbc-4bf9-982b-52c796457f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:27.513382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 683/1367] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:27.517666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a105ac-8c9b-47fd-adbf-baff3291e262 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:27.561433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a105ac-8c9b-47fd-adbf-baff3291e262 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:27.577367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:27.578032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:27.578307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:27.578576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:27.594574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:27.595234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c7f80-dc3a-4078-b622-132d25cdab11 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:27.615671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 685/1368] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:30.004404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd261-fa1e-40de-97b3-a30418d79763 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.004982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd261-fa1e-40de-97b3-a30418d79763 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.004982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00bd261-fa1e-40de-97b3-a30418d79763 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.010022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 684/1369] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:30.012113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a589d8-68d9-4f2c-8c3e-9d95054664a4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.012950 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a589d8-68d9-4f2c-8c3e-9d95054664a4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.013437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a589d8-68d9-4f2c-8c3e-9d95054664a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.035916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b6a589d8-68d9-4f2c-8c3e-9d95054664a4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:30.037453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b6a589d8-68d9-4f2c-8c3e-9d95054664a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:30.060076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 686/1370] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:30.099271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bd261-fa1e-40de-97b3-a30418d79763 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.114714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00bd261-fa1e-40de-97b3-a30418d79763 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.120691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.121644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.122077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.122511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.134319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:30.136241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02151eb-8044-47d7-a572-0e0ab5c5eef4 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:30.148428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 685/1371] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:30.472268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615dc7-53dd-4850-b39f-c6822368e16b None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.472966 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615dc7-53dd-4850-b39f-c6822368e16b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.473348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3615dc7-53dd-4850-b39f-c6822368e16b None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.474819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 687/1372] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:30.480894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e120e-79b2-4f8a-af41-938c0b88ee0c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.482383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e120e-79b2-4f8a-af41-938c0b88ee0c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.482884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e120e-79b2-4f8a-af41-938c0b88ee0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.503782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-575e120e-79b2-4f8a-af41-938c0b88ee0c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:30.505493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-575e120e-79b2-4f8a-af41-938c0b88ee0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:30.524190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 686/1373] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:30.806708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760e4e-1a76-4209-964a-698f4b889fd0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.807292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760e4e-1a76-4209-964a-698f4b889fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.807863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd760e4e-1a76-4209-964a-698f4b889fd0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.809455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 688/1374] 10.222.0.23 () {54 vars in 963 bytes} [Wed May 4 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:30.814607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c29d9-644c-4857-ad49-fbb3fb836477 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.815192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c29d9-644c-4857-ad49-fbb3fb836477 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.815674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c29d9-644c-4857-ad49-fbb3fb836477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:30.876096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a50c29d9-644c-4857-ad49-fbb3fb836477 None None] MFA Rules not processed for user `93f8c6e46f6d4cc8a3364bfa3e6b93d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:30.879234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a50c29d9-644c-4857-ad49-fbb3fb836477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:30.956708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 687/1375] 10.222.0.23 () {58 vars in 1060 bytes} [Wed May 4 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:30.969084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760e4e-1a76-4209-964a-698f4b889fd0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:30.984256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd760e4e-1a76-4209-964a-698f4b889fd0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:30.989020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:30.990175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:30.990699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:30.991425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:31.004227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:31.007546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74a23f-2ac2-4a7d-acad-6006399b2c28 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:31.035271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 689/1376] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:32.445722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636263-536c-491d-91fb-3e1f572669a7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.445722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636263-536c-491d-91fb-3e1f572669a7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.445722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98636263-536c-491d-91fb-3e1f572669a7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.445722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 688/1377] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:32.451232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64152699-ad50-4599-8471-2735d36c0660 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.451676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64152699-ad50-4599-8471-2735d36c0660 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.451819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64152699-ad50-4599-8471-2735d36c0660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.469946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-64152699-ad50-4599-8471-2735d36c0660 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:32.471464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-64152699-ad50-4599-8471-2735d36c0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:32.480437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 690/1378] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:32.524038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636263-536c-491d-91fb-3e1f572669a7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:32.540558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98636263-536c-491d-91fb-3e1f572669a7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:32.546234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:32.546994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:32.547270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:32.547731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:32.556724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:32.558328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbce269-8a80-4382-b2a1-ed81aebf3873 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:32.578564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 689/1379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:34.879695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd214-e511-4720-81e3-56a71716522a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.880254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd214-e511-4720-81e3-56a71716522a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.880254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dd214-e511-4720-81e3-56a71716522a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.881682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 691/1380] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:34.887097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4762dd-7c8b-4df2-a08a-1566a984f5cd None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.887539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4762dd-7c8b-4df2-a08a-1566a984f5cd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.887689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4762dd-7c8b-4df2-a08a-1566a984f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:34.906156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0e4762dd-7c8b-4df2-a08a-1566a984f5cd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:34.909101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0e4762dd-7c8b-4df2-a08a-1566a984f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:34.916414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 690/1381] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:34.967190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd214-e511-4720-81e3-56a71716522a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:34.981795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dd214-e511-4720-81e3-56a71716522a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:34.994218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:34.994885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:34.995164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:34.995456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:35.010153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:35.011590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95da0d4-f86e-41c4-9430-79d3037c3d4e service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:35.037079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 692/1382] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:37.312355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474289-e8f7-4c02-bd97-ebfcfda8b9ee None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.312906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474289-e8f7-4c02-bd97-ebfcfda8b9ee None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.312906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55474289-e8f7-4c02-bd97-ebfcfda8b9ee None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.314847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 691/1383] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:37.319867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a9f-c4f5-4ad8-9e73-d98a23628188 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.320366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a9f-c4f5-4ad8-9e73-d98a23628188 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.320450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f617a9f-c4f5-4ad8-9e73-d98a23628188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.339243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8f617a9f-c4f5-4ad8-9e73-d98a23628188 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:37.340443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8f617a9f-c4f5-4ad8-9e73-d98a23628188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:37.348802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 693/1384] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:37.389232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55474289-e8f7-4c02-bd97-ebfcfda8b9ee None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:37.403889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55474289-e8f7-4c02-bd97-ebfcfda8b9ee None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:37.409375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:37.410000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:37.410277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:37.410544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:37.418472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:37.420085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2f92e-4992-4a0c-97b6-0e2066f2e46a service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:37.429852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 692/1385] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:39.738509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80f44-15c1-489e-b498-0d3807103d55 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:39.739097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80f44-15c1-489e-b498-0d3807103d55 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:39.739211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d80f44-15c1-489e-b498-0d3807103d55 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:39.741056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 694/1386] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:39.746901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee461-127e-4188-af74-a4937f65aa33 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:39.747361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee461-127e-4188-af74-a4937f65aa33 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:39.747600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ee461-127e-4188-af74-a4937f65aa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:39.771434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-186ee461-127e-4188-af74-a4937f65aa33 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:39.773111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-186ee461-127e-4188-af74-a4937f65aa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:39.782221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 693/1387] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:39.837039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80f44-15c1-489e-b498-0d3807103d55 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:39.855997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d80f44-15c1-489e-b498-0d3807103d55 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:39.864118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:39.864767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:39.865052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:39.865325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:39.874408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:39.876039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcaac6-a65c-4052-a8c1-1399154b6b16 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:39.885825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 695/1388] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:42.197399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bd5a8-8c08-409d-b6ee-4e5ce2fda96a None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.198068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bd5a8-8c08-409d-b6ee-4e5ce2fda96a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.198068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bd5a8-8c08-409d-b6ee-4e5ce2fda96a None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.199873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 694/1389] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:42.205486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cdc19-08f5-46a2-a439-81433a3a4370 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.205943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cdc19-08f5-46a2-a439-81433a3a4370 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.206216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cdc19-08f5-46a2-a439-81433a3a4370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.228936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3c1cdc19-08f5-46a2-a439-81433a3a4370 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:42.230454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3c1cdc19-08f5-46a2-a439-81433a3a4370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:42.241567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 696/1390] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:42.286327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bd5a8-8c08-409d-b6ee-4e5ce2fda96a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:42.300701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bd5a8-8c08-409d-b6ee-4e5ce2fda96a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:42.305949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:42.306589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:42.306871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:42.307143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:42.315269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:42.316888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8a6e-440a-41bf-ac7f-dd975c96e9a4 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:42.326440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 695/1391] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:44.589183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7044-dbe5-4198-962d-97bc5967927a None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.589819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7044-dbe5-4198-962d-97bc5967927a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.589819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af7044-dbe5-4198-962d-97bc5967927a None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.591101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 697/1392] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:44.596946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb810c9-9a09-4bdf-a654-b95d83a28116 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.597370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb810c9-9a09-4bdf-a654-b95d83a28116 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.597657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb810c9-9a09-4bdf-a654-b95d83a28116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.621488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-feb810c9-9a09-4bdf-a654-b95d83a28116 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:44.622964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-feb810c9-9a09-4bdf-a654-b95d83a28116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:44.639510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 696/1393] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:44.689887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af7044-dbe5-4198-962d-97bc5967927a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:44.704976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af7044-dbe5-4198-962d-97bc5967927a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:44.710423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:44.711058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:44.711338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:44.711642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:44.720010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:44.721575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e13f01c-4127-4fc3-bb4f-7d2f3391c793 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:44.730860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 698/1394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:46.970976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549252-361c-4ba9-b968-de7337a63f74 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.971623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549252-361c-4ba9-b968-de7337a63f74 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.971623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca549252-361c-4ba9-b968-de7337a63f74 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.972884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 697/1395] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:46.978157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45539e7-4379-4e02-9fda-e8f97b98b8a9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:46.978614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45539e7-4379-4e02-9fda-e8f97b98b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:46.978723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45539e7-4379-4e02-9fda-e8f97b98b8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:46.996606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a45539e7-4379-4e02-9fda-e8f97b98b8a9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:46.997764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a45539e7-4379-4e02-9fda-e8f97b98b8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:47.005985 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 699/1396] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:47.024998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a5a7-99a5-4ed8-a4a3-4283e360c7f3 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.025283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a5a7-99a5-4ed8-a4a3-4283e360c7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.025556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3a5a7-99a5-4ed8-a4a3-4283e360c7f3 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.026960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 698/1397] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:47.032396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e402c-fc63-4be2-921b-a867d9ce4bbb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.032681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e402c-fc63-4be2-921b-a867d9ce4bbb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.032963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e402c-fc63-4be2-921b-a867d9ce4bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.048029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a5a7-99a5-4ed8-a4a3-4283e360c7f3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:47.054107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-be6e402c-fc63-4be2-921b-a867d9ce4bbb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:47.055283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-be6e402c-fc63-4be2-921b-a867d9ce4bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:47.062266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd3a5a7-99a5-4ed8-a4a3-4283e360c7f3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:47.064352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 700/1398] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:47.067808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:47.068431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.068702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.068975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.077352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:47.078943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecb358-54f3-4ecd-8638-e80ca254616f service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:47.087964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 699/1399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:32:47.120768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7bca-144e-4a30-a544-cc5cbb32c4a7 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.121054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7bca-144e-4a30-a544-cc5cbb32c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.121326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7bca-144e-4a30-a544-cc5cbb32c4a7 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.122961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 701/1400] 10.222.0.23 () {54 vars in 962 bytes} [Wed May 4 21:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:47.127932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346343d1-a17d-4d37-bb12-609b718761fd None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.128329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346343d1-a17d-4d37-bb12-609b718761fd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.128699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346343d1-a17d-4d37-bb12-609b718761fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.182468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-346343d1-a17d-4d37-bb12-609b718761fd None None] MFA Rules not processed for user `41e2d642d4db4a7f92fd6b45ebb5f8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:47.183779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-346343d1-a17d-4d37-bb12-609b718761fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:47.250679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 700/1401] 10.222.0.23 () {58 vars in 1059 bytes} [Wed May 4 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:47.258182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7bca-144e-4a30-a544-cc5cbb32c4a7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:47.270039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7bca-144e-4a30-a544-cc5cbb32c4a7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:47.273739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:47.274390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.274666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.274939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.284933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:47.286409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123269bc-d88f-4521-808b-2935cc44b9c3 service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:47.296802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 702/1402] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:32:47.720054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21fbf-059b-4bcc-9612-58be1efad9bf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.720440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21fbf-059b-4bcc-9612-58be1efad9bf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.720719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba21fbf-059b-4bcc-9612-58be1efad9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.769293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9ba21fbf-059b-4bcc-9612-58be1efad9bf None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:47.770392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9ba21fbf-059b-4bcc-9612-58be1efad9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:47.833487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 701/1403] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:47.882301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d2cb-5a1e-48d7-abe3-78a896e8dcc5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.882741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d2cb-5a1e-48d7-abe3-78a896e8dcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.883108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2d2cb-5a1e-48d7-abe3-78a896e8dcc5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.885995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 703/1404] 10.222.0.23 () {54 vars in 942 bytes} [Wed May 4 21:32:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:47.894905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3ffb4-4571-4c11-91b1-57e2887d9716 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:47.895254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3ffb4-4571-4c11-91b1-57e2887d9716 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:47.895576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3ffb4-4571-4c11-91b1-57e2887d9716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:47.944276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c4f3ffb4-4571-4c11-91b1-57e2887d9716 None None] MFA Rules not processed for user `cb0727d888284c15a4eb6fd7126f7d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:47.945457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c4f3ffb4-4571-4c11-91b1-57e2887d9716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:48.013329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 702/1405] 10.222.0.23 () {58 vars in 1039 bytes} [Wed May 4 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:32:48.022878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d2cb-5a1e-48d7-abe3-78a896e8dcc5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:48.035913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2d2cb-5a1e-48d7-abe3-78a896e8dcc5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:48.041551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:48.042204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:48.042484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:48.042754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:48.050949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:48.052561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b37348-42bd-4705-b2e6-cac98136b82d service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:48.060702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 704/1406] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:32:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 21:32:49.344574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8bef-76ab-409b-b137-4c4ad749c1a3 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.345141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8bef-76ab-409b-b137-4c4ad749c1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.345141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce8bef-76ab-409b-b137-4c4ad749c1a3 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.346507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 703/1407] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:32:49.351793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade385f-8e2a-4762-85cb-4dc6229497cd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.352566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade385f-8e2a-4762-85cb-4dc6229497cd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.352848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade385f-8e2a-4762-85cb-4dc6229497cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.371132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4ade385f-8e2a-4762-85cb-4dc6229497cd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:32:49.372388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4ade385f-8e2a-4762-85cb-4dc6229497cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:32:49.381661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 705/1408] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:32:49.430477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce8bef-76ab-409b-b137-4c4ad749c1a3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:32:49.445021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce8bef-76ab-409b-b137-4c4ad749c1a3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:32:49.453361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:32:49.454082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:32:49.454362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:32:49.454635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:32:49.463858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:32:49.465461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a9319-2df8-4688-8020-61a8bf465e9d service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:32:49.475042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 704/1409] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:10.744417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc79d7-13c1-45b7-a91c-3f5ec16584bf None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.745118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc79d7-13c1-45b7-a91c-3f5ec16584bf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.745118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc79d7-13c1-45b7-a91c-3f5ec16584bf None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.746324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 706/1410] 10.222.0.23 () {54 vars in 918 bytes} [Wed May 4 21:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:10.752440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f6c8-cab6-4891-bb37-dec6885c5942 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.753229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f6c8-cab6-4891-bb37-dec6885c5942 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.753229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f6c8-cab6-4891-bb37-dec6885c5942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.782365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6993f6c8-cab6-4891-bb37-dec6885c5942 None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:10.783592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6993f6c8-cab6-4891-bb37-dec6885c5942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:10.793781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 705/1411] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:10.813675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4423ff6-b5e2-43a0-bd54-0c5598b276ec None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.813956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4423ff6-b5e2-43a0-bd54-0c5598b276ec None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.814226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4423ff6-b5e2-43a0-bd54-0c5598b276ec None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.815609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 707/1412] 10.222.0.23 () {54 vars in 918 bytes} [Wed May 4 21:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:10.820139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9567ff-6ffc-413d-95d4-2a50fbb9637c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:10.820432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9567ff-6ffc-413d-95d4-2a50fbb9637c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:10.820714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9567ff-6ffc-413d-95d4-2a50fbb9637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:10.839892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1a9567ff-6ffc-413d-95d4-2a50fbb9637c None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:10.841066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1a9567ff-6ffc-413d-95d4-2a50fbb9637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:10.850948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 706/1413] 10.222.0.23 () {58 vars in 1015 bytes} [Wed May 4 21:33:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:33:13.555868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7c5d-7966-4c9a-9908-09c149f159b3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.556429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7c5d-7966-4c9a-9908-09c149f159b3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.556429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d7c5d-7966-4c9a-9908-09c149f159b3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.557693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:13.563779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e45e-6e2a-463c-9c3f-8ce790684291 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.564242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e45e-6e2a-463c-9c3f-8ce790684291 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.564351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb60e45e-6e2a-463c-9c3f-8ce790684291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.583250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-fb60e45e-6e2a-463c-9c3f-8ce790684291 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:13.584464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fb60e45e-6e2a-463c-9c3f-8ce790684291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:13.593947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:13.655074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7c5d-7966-4c9a-9908-09c149f159b3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:13.676252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d7c5d-7966-4c9a-9908-09c149f159b3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:13.682134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:13.682766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:13.683050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:13.683351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:13.692627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:13.694210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba29f1-52f3-478b-93d9-d5a2813d1bde service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:13.704956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 709/1416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:15.000583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c5ea-12e0-4385-bc2c-4b91d4f7f2bd None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:15.001192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c5ea-12e0-4385-bc2c-4b91d4f7f2bd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:15.001192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727c5ea-12e0-4385-bc2c-4b91d4f7f2bd None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:15.002488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:15.008647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec456-e8eb-4174-8381-5e73dfa30f8e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:15.009374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec456-e8eb-4174-8381-5e73dfa30f8e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:15.009532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec456-e8eb-4174-8381-5e73dfa30f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:15.036930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e31ec456-e8eb-4174-8381-5e73dfa30f8e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:15.038118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e31ec456-e8eb-4174-8381-5e73dfa30f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:15.046858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:15.221005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c5ea-12e0-4385-bc2c-4b91d4f7f2bd None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:15.243943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727c5ea-12e0-4385-bc2c-4b91d4f7f2bd None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:15.251524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:15.252125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:15.252368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:15.252656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:15.261681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:15.263262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b2ccee-4357-4af9-a9f1-c8bad117f3dc service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:15.272826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 709/1419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:16.512974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf9da-c328-4482-9e47-071357d6685f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:16.513834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf9da-c328-4482-9e47-071357d6685f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:16.513834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accf9da-c328-4482-9e47-071357d6685f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:16.515971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:16.524129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f6ed-4bbd-4b29-bca4-91355b60d580 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:16.524573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f6ed-4bbd-4b29-bca4-91355b60d580 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:16.524674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3f6ed-4bbd-4b29-bca4-91355b60d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:16.546351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d1b3f6ed-4bbd-4b29-bca4-91355b60d580 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:16.547569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d1b3f6ed-4bbd-4b29-bca4-91355b60d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:16.556488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:16.711117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf9da-c328-4482-9e47-071357d6685f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:16.728309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0accf9da-c328-4482-9e47-071357d6685f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:16.734335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:16.734982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:16.735266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:16.735573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:16.743803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:16.745384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae5316-6dc8-4c5b-abe8-0f134511a2c9 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:16.755659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 712/1422] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:18.000261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba92e67-6f7d-4462-93c4-36e2a76a0756 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.001096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba92e67-6f7d-4462-93c4-36e2a76a0756 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.001096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba92e67-6f7d-4462-93c4-36e2a76a0756 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.002609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:18.008555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d51f-fa6d-4243-8929-2c3e0a1d26c8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.009055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d51f-fa6d-4243-8929-2c3e0a1d26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.009165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073d51f-fa6d-4243-8929-2c3e0a1d26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.034909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a073d51f-fa6d-4243-8929-2c3e0a1d26c8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:18.036135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a073d51f-fa6d-4243-8929-2c3e0a1d26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:18.044827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:18.191880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba92e67-6f7d-4462-93c4-36e2a76a0756 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:18.217421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba92e67-6f7d-4462-93c4-36e2a76a0756 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:18.224969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:18.225602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:18.225880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:18.226149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:18.234944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:18.236571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580d9b-a262-46a7-b73f-01f781fd6efa service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:18.246473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 712/1425] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:19.470328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e447a7-0151-46f6-9b59-37f7259c2675 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.470940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e447a7-0151-46f6-9b59-37f7259c2675 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.470940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e447a7-0151-46f6-9b59-37f7259c2675 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.472265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:19.478347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c71-b026-4d5d-9c51-62a7b0d291ce None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.479014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c71-b026-4d5d-9c51-62a7b0d291ce None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.479269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7c71-b026-4d5d-9c51-62a7b0d291ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.508311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8e6a7c71-b026-4d5d-9c51-62a7b0d291ce None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:19.509413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8e6a7c71-b026-4d5d-9c51-62a7b0d291ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:19.518659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:19.670477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e447a7-0151-46f6-9b59-37f7259c2675 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:19.691783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e447a7-0151-46f6-9b59-37f7259c2675 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:19.698663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:19.699633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:19.699915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:19.700191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:19.708652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:19.710278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a57186-ffdf-477e-8860-6794ed88f384 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:19.721960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 715/1428] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:33:20.913216 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98108e-3bc7-4c84-9fb4-5d20834daf71 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:20.913823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98108e-3bc7-4c84-9fb4-5d20834daf71 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:20.913823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98108e-3bc7-4c84-9fb4-5d20834daf71 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:20.915153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:20.921225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058005-1328-48ee-8b3a-f06719661482 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:20.921727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058005-1328-48ee-8b3a-f06719661482 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:20.921727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf058005-1328-48ee-8b3a-f06719661482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:20.942525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bf058005-1328-48ee-8b3a-f06719661482 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:20.943739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bf058005-1328-48ee-8b3a-f06719661482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:20.953456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:21.113854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98108e-3bc7-4c84-9fb4-5d20834daf71 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:21.134444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98108e-3bc7-4c84-9fb4-5d20834daf71 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:21.141107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:21.141917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:21.142198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:21.142467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:21.151171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:21.152820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf3499-bdf1-4c01-9140-3131533e1073 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:21.162606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 715/1431] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:22.391596 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a696-e15f-444c-977a-7b82cabe7fca None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.392161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a696-e15f-444c-977a-7b82cabe7fca None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.392161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31a696-e15f-444c-977a-7b82cabe7fca None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.393525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:22.399494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c0-62c3-4537-a92a-b04751a6401e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.400193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c0-62c3-4537-a92a-b04751a6401e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.400315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1dd7c0-62c3-4537-a92a-b04751a6401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.421097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-bb1dd7c0-62c3-4537-a92a-b04751a6401e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:22.422269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bb1dd7c0-62c3-4537-a92a-b04751a6401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:22.430540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:22.583121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a696-e15f-444c-977a-7b82cabe7fca None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:22.604090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31a696-e15f-444c-977a-7b82cabe7fca None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:22.610621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:22.611254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:22.611590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:22.611840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:22.620400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:22.621973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4347f-b7d7-4bbf-80f3-54c703d00886 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:22.631755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 718/1434] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:23.819917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c29561-ec97-4a2a-96f5-099ebd61340c None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.820487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c29561-ec97-4a2a-96f5-099ebd61340c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.820487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c29561-ec97-4a2a-96f5-099ebd61340c None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.822273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:23.828441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f07f-630b-4c29-902c-c4f2c8189e71 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:23.829241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f07f-630b-4c29-902c-c4f2c8189e71 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:23.829346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24f07f-630b-4c29-902c-c4f2c8189e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:23.848016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5f24f07f-630b-4c29-902c-c4f2c8189e71 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:23.849247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5f24f07f-630b-4c29-902c-c4f2c8189e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:23.858213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:24.009595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c29561-ec97-4a2a-96f5-099ebd61340c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:24.033766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c29561-ec97-4a2a-96f5-099ebd61340c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:24.040050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:24.040680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:24.040944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:24.041230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:24.049031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:24.050605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611dfd2b-12de-40f6-acf5-b8ba76079b69 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:24.060205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 718/1437] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:25.237910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ce0d-476e-4c14-95d4-1a76fde3dfe3 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.238406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ce0d-476e-4c14-95d4-1a76fde3dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.238406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78ce0d-476e-4c14-95d4-1a76fde3dfe3 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.239843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:25.244953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a866c-b99f-4f22-a1ed-9f112314c100 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.245417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a866c-b99f-4f22-a1ed-9f112314c100 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.245536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a866c-b99f-4f22-a1ed-9f112314c100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.263879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a56a866c-b99f-4f22-a1ed-9f112314c100 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:25.265041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a56a866c-b99f-4f22-a1ed-9f112314c100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:25.273179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:25.420838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ce0d-476e-4c14-95d4-1a76fde3dfe3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:25.436734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78ce0d-476e-4c14-95d4-1a76fde3dfe3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:25.442808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:25.443433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:25.443731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:25.443980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:25.452321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:25.453869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fba1c-a64c-4741-bbc3-d21f068219ab service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:25.463148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 721/1440] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:27.603083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5dc9-51fe-4205-a46c-799fb66e4714 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.603613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5dc9-51fe-4205-a46c-799fb66e4714 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.603709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a5dc9-51fe-4205-a46c-799fb66e4714 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.605050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:27.610850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81faa-0e96-4e2c-984c-8217dd3782a9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.611276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81faa-0e96-4e2c-984c-8217dd3782a9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.611425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a81faa-0e96-4e2c-984c-8217dd3782a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.630111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d3a81faa-0e96-4e2c-984c-8217dd3782a9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:27.631307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d3a81faa-0e96-4e2c-984c-8217dd3782a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:27.640862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:27.680827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a5dc9-51fe-4205-a46c-799fb66e4714 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:27.694660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a5dc9-51fe-4205-a46c-799fb66e4714 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:27.698372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:27.699004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:27.699278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:27.699882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:27.709941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:27.711967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ee393-0eeb-497a-bb02-9290ccd14863 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:27.721989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 721/1443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:30.174616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b40-a85d-41ee-9d51-68677a7ff602 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.175166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b40-a85d-41ee-9d51-68677a7ff602 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.175166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e4b40-a85d-41ee-9d51-68677a7ff602 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.176509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:30.182887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829ca84-772d-4bfb-ae51-7c7e37a03bca None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.183674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829ca84-772d-4bfb-ae51-7c7e37a03bca None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.183853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829ca84-772d-4bfb-ae51-7c7e37a03bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.204577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8829ca84-772d-4bfb-ae51-7c7e37a03bca None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:30.205787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8829ca84-772d-4bfb-ae51-7c7e37a03bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:30.214168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:30.254626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4b40-a85d-41ee-9d51-68677a7ff602 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:30.269271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e4b40-a85d-41ee-9d51-68677a7ff602 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:30.274288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:30.275191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:30.275544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:30.275866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:30.288460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:30.289901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c71b98-8abe-4ace-a4ef-165be0ba4de6 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:30.299784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 724/1446] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:32.820685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c51e2-2361-436d-a3c4-b0ed036b2ba7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.821362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c51e2-2361-436d-a3c4-b0ed036b2ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.821362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3c51e2-2361-436d-a3c4-b0ed036b2ba7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.822575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:32.829394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d24f-96c0-47ad-9af7-a6283fbb8b70 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.830072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d24f-96c0-47ad-9af7-a6283fbb8b70 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.830324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8d24f-96c0-47ad-9af7-a6283fbb8b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.849413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4fc8d24f-96c0-47ad-9af7-a6283fbb8b70 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:32.850620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4fc8d24f-96c0-47ad-9af7-a6283fbb8b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:32.861048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:32.911877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c51e2-2361-436d-a3c4-b0ed036b2ba7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:32.927853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3c51e2-2361-436d-a3c4-b0ed036b2ba7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:32.932414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:32.933055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:32.933335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:32.933607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:32.942846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:32.944332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767824b1-8f1e-4927-8060-e0c1198045c0 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:32.953992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 724/1449] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:35.345234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093256-62d8-454b-b33f-66655d304761 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.345859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093256-62d8-454b-b33f-66655d304761 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.345971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093256-62d8-454b-b33f-66655d304761 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.347318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:35.353801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c4c-d0c3-433f-9048-e570b04799b9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.354523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c4c-d0c3-433f-9048-e570b04799b9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.354689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2510c4c-d0c3-433f-9048-e570b04799b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.381144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d2510c4c-d0c3-433f-9048-e570b04799b9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:35.382330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d2510c4c-d0c3-433f-9048-e570b04799b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:35.392522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:35.432356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6093256-62d8-454b-b33f-66655d304761 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:35.444294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6093256-62d8-454b-b33f-66655d304761 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:35.448722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:35.449350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:35.449625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:35.449891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:35.460078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:35.461495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ae866-69e8-4240-8cfc-4d8c1b3535c0 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:35.470894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 727/1452] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:37.745150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3333050-c788-4cbd-9c16-1fd5b5831882 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.745750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3333050-c788-4cbd-9c16-1fd5b5831882 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.745750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3333050-c788-4cbd-9c16-1fd5b5831882 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.747074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:33:37.753611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b199-4619-4403-976b-a77985691c4e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.754363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b199-4619-4403-976b-a77985691c4e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.754505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b199-4619-4403-976b-a77985691c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.783468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0fc7b199-4619-4403-976b-a77985691c4e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:37.784654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0fc7b199-4619-4403-976b-a77985691c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:37.793437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:37.830951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3333050-c788-4cbd-9c16-1fd5b5831882 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:37.843272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3333050-c788-4cbd-9c16-1fd5b5831882 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:37.847176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:37.847835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:37.848107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:37.848375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:37.857433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:37.858849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939457d-61a3-4776-848a-53f12d62c855 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:37.868996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 727/1455] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:40.122811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a19-0342-44ac-841f-1a2fbce71a3f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.123435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a19-0342-44ac-841f-1a2fbce71a3f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.123435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a57a19-0342-44ac-841f-1a2fbce71a3f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.124763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:40.131262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac9da-0065-4a43-a201-7ef1bf8ae5cb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.132003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac9da-0065-4a43-a201-7ef1bf8ae5cb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.132206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ac9da-0065-4a43-a201-7ef1bf8ae5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.154931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1f2ac9da-0065-4a43-a201-7ef1bf8ae5cb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:40.156089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1f2ac9da-0065-4a43-a201-7ef1bf8ae5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:40.165036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:40.214659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57a19-0342-44ac-841f-1a2fbce71a3f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:40.225915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a57a19-0342-44ac-841f-1a2fbce71a3f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:40.229736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:40.230340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:40.230611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:40.230887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:40.239964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:40.241376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f0dfd-472f-4da8-a3e0-a3d15a231feb service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:40.250957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 730/1458] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:33:42.528596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba473e-c8c8-42ba-9658-524648da35d1 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.529110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba473e-c8c8-42ba-9658-524648da35d1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.529110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba473e-c8c8-42ba-9658-524648da35d1 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.531157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:42.537693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ef6e-71d4-42cf-99a3-f8e9b672abbf None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.538192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ef6e-71d4-42cf-99a3-f8e9b672abbf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.538296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417ef6e-71d4-42cf-99a3-f8e9b672abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.556996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6417ef6e-71d4-42cf-99a3-f8e9b672abbf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:42.558158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6417ef6e-71d4-42cf-99a3-f8e9b672abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:42.566768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:33:42.607455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba473e-c8c8-42ba-9658-524648da35d1 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:42.623713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba473e-c8c8-42ba-9658-524648da35d1 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:42.628638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:42.629234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:42.629517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:42.629781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:42.638317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:42.639761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171dda4-e5d7-49ff-bfca-ef5ce8b428de service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:42.648658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 730/1461] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:44.898296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac082f0-759f-4599-802a-15e79a42e940 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.899215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac082f0-759f-4599-802a-15e79a42e940 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.899404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac082f0-759f-4599-802a-15e79a42e940 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.901712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:44.908042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342137-d426-40ac-807b-ea6d8bbdfdcc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:44.908814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342137-d426-40ac-807b-ea6d8bbdfdcc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:44.908922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba342137-d426-40ac-807b-ea6d8bbdfdcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:44.927727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ba342137-d426-40ac-807b-ea6d8bbdfdcc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:44.928916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ba342137-d426-40ac-807b-ea6d8bbdfdcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:44.938472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:44.989499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac082f0-759f-4599-802a-15e79a42e940 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:45.001841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac082f0-759f-4599-802a-15e79a42e940 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:45.006083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:45.006710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:45.006991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:45.007266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:45.016485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:45.017893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66807c9-e870-4539-a0ea-bfb4d9878c5e service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:45.027244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 733/1464] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:47.271096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e670-d946-4745-b679-dd009b269984 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.271629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e670-d946-4745-b679-dd009b269984 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.271629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9e670-d946-4745-b679-dd009b269984 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.273043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:47.279069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eb27-e9d7-448f-b449-0f65205ca8b5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.279540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eb27-e9d7-448f-b449-0f65205ca8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.279642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620eb27-e9d7-448f-b449-0f65205ca8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.299301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5620eb27-e9d7-448f-b449-0f65205ca8b5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:47.300473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5620eb27-e9d7-448f-b449-0f65205ca8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:47.309396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:47.349457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9e670-d946-4745-b679-dd009b269984 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:47.361033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9e670-d946-4745-b679-dd009b269984 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:47.364857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:47.365485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:47.365765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:47.366030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:47.374554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:47.376019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac33f66-01de-4244-9231-607ccdfb3cb3 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:47.387441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 733/1467] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:33:49.612758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89467-2163-40fc-86d5-b5919d154bb6 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.613384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89467-2163-40fc-86d5-b5919d154bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.613384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf89467-2163-40fc-86d5-b5919d154bb6 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.614746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:33:49.620407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9e3d-fccc-4acc-b7b7-591971d2925d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.620847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9e3d-fccc-4acc-b7b7-591971d2925d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.620952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b9e3d-fccc-4acc-b7b7-591971d2925d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.640247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7d6b9e3d-fccc-4acc-b7b7-591971d2925d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:33:49.641442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7d6b9e3d-fccc-4acc-b7b7-591971d2925d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:33:49.651105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:33:49.687809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89467-2163-40fc-86d5-b5919d154bb6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:33:49.704762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf89467-2163-40fc-86d5-b5919d154bb6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:33:49.709522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:33:49.710146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:33:49.710424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:33:49.710688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:33:49.720221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:33:49.721651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d98f1-fd8e-411c-8030-4afdcfca89dc service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:33:49.731481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 736/1470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:22.604087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217124b2-880a-4652-b2f7-cd39cdefd9de None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.605003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217124b2-880a-4652-b2f7-cd39cdefd9de None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.605003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217124b2-880a-4652-b2f7-cd39cdefd9de None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.607126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 735/1471] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:22.612533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21cfca-1404-40ee-be22-dabdaaa3a461 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.612995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21cfca-1404-40ee-be22-dabdaaa3a461 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.613104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21cfca-1404-40ee-be22-dabdaaa3a461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.631005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8a21cfca-1404-40ee-be22-dabdaaa3a461 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:22.632248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8a21cfca-1404-40ee-be22-dabdaaa3a461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:22.640486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 737/1472] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:34:22.688001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b77d-3372-4f15-9296-f9435adbe8c5 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.688438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b77d-3372-4f15-9296-f9435adbe8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.688871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214b77d-3372-4f15-9296-f9435adbe8c5 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.691248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 736/1473] 10.222.0.23 () {54 vars in 962 bytes} [Wed May 4 21:34:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:22.696227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf9a0-76a4-481b-a864-b56f53b279c4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.696515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf9a0-76a4-481b-a864-b56f53b279c4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.696793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cf9a0-76a4-481b-a864-b56f53b279c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.716408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-470cf9a0-76a4-481b-a864-b56f53b279c4 None None] MFA Rules not processed for user `41e2d642d4db4a7f92fd6b45ebb5f8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:22.717577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-470cf9a0-76a4-481b-a864-b56f53b279c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:22.724412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 738/1474] 10.222.0.23 () {58 vars in 1059 bytes} [Wed May 4 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:34:22.731970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b77d-3372-4f15-9296-f9435adbe8c5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:22.746307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214b77d-3372-4f15-9296-f9435adbe8c5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:22.750825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:22.751455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:22.751755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:22.752022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:22.761837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:22.763258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249a8ec-9b6f-4b9d-a762-0df20a5f47c4 service glance] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:22.773147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 737/1475] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:25.114660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30151a-47a9-4ba7-910e-7ea7215994b0 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.115221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30151a-47a9-4ba7-910e-7ea7215994b0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.115221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30151a-47a9-4ba7-910e-7ea7215994b0 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.116611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 739/1476] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:25.121810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595654-9cd1-4601-86a5-9afab78b57d2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.122286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595654-9cd1-4601-86a5-9afab78b57d2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.122392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5595654-9cd1-4601-86a5-9afab78b57d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.140222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c5595654-9cd1-4601-86a5-9afab78b57d2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:25.141316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c5595654-9cd1-4601-86a5-9afab78b57d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:25.150866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 738/1477] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:25.174434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30151a-47a9-4ba7-910e-7ea7215994b0 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:25.188215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30151a-47a9-4ba7-910e-7ea7215994b0 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:25.193365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:25.194017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:25.194294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:25.194563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:25.195298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:25.197114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:34:25.197114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:34:25.197114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:34:25.198266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9803a28d-7cd8-4e55-942c-119f1a1e1c29 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:25.219594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 740/1478] 10.222.0.23 () {56 vars in 1108 bytes} [Wed May 4 21:34:25 2022] GET /identity/v3/projects => generated 2553 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:34:27.462990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65bd0-c6c5-4159-9dd2-c9389bca2118 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.463562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65bd0-c6c5-4159-9dd2-c9389bca2118 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.463562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa65bd0-c6c5-4159-9dd2-c9389bca2118 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.465095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 739/1479] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:27.470360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a570-085f-4188-9df8-f311b84653dd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.470803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a570-085f-4188-9df8-f311b84653dd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.470909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907a570-085f-4188-9df8-f311b84653dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.488811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8907a570-085f-4188-9df8-f311b84653dd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:27.489987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8907a570-085f-4188-9df8-f311b84653dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:27.498358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 741/1480] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:27.540724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65bd0-c6c5-4159-9dd2-c9389bca2118 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:27.555855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa65bd0-c6c5-4159-9dd2-c9389bca2118 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:27.566537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:27.567198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:27.567535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:27.567792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:27.578061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:27.580074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f039ae-29f7-4395-ab48-67d5f0f6a24f service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:27.594189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 740/1481] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:30.075239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5b00-b5c2-4303-8efa-bd0ac3c666d2 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.075786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5b00-b5c2-4303-8efa-bd0ac3c666d2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.075786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5b00-b5c2-4303-8efa-bd0ac3c666d2 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.077141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 742/1482] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:30.083224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771330-19bf-4c2d-91b2-9295880d905d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.083773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771330-19bf-4c2d-91b2-9295880d905d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.083773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f771330-19bf-4c2d-91b2-9295880d905d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.104465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1f771330-19bf-4c2d-91b2-9295880d905d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:30.105683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1f771330-19bf-4c2d-91b2-9295880d905d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:30.114993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 741/1483] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:30.151069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5b00-b5c2-4303-8efa-bd0ac3c666d2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:30.162550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5b00-b5c2-4303-8efa-bd0ac3c666d2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:30.166395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:30.167036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:30.167314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:30.167639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:30.177678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:30.179194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f35f3-caad-4b79-b018-243690adf26b service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:30.189375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 743/1484] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:32.484969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd5cbf-7a39-4e90-938b-ed8b3c7e8672 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.485572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd5cbf-7a39-4e90-938b-ed8b3c7e8672 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.485572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd5cbf-7a39-4e90-938b-ed8b3c7e8672 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.486795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 742/1485] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:32.492287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e5c-50e2-4803-9d34-07a7a5d599ec None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.492754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e5c-50e2-4803-9d34-07a7a5d599ec None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.492870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d9e5c-50e2-4803-9d34-07a7a5d599ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.510555 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f03d9e5c-50e2-4803-9d34-07a7a5d599ec None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:32.511702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f03d9e5c-50e2-4803-9d34-07a7a5d599ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:32.527647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 744/1486] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:32.556779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd5cbf-7a39-4e90-938b-ed8b3c7e8672 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:32.567472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd5cbf-7a39-4e90-938b-ed8b3c7e8672 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:32.570955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:32.571954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:32.571954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:32.572183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:32.584326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:32.585873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48180a9a-f2e2-4669-8014-fe95c4de86e1 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:32.595232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 743/1487] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:34.913182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e6da-eea7-431b-87fc-cce15d22e1ed None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:34.913757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e6da-eea7-431b-87fc-cce15d22e1ed None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:34.913757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e6da-eea7-431b-87fc-cce15d22e1ed None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:34.915940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 745/1488] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:34:34.924198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe9210-c6e5-45ae-9ce6-d4a101fa9485 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:34.924619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe9210-c6e5-45ae-9ce6-d4a101fa9485 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:34.924748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe9210-c6e5-45ae-9ce6-d4a101fa9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:34.949056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1ebe9210-c6e5-45ae-9ce6-d4a101fa9485 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:34.950247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1ebe9210-c6e5-45ae-9ce6-d4a101fa9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:34.959245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 744/1489] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:35.001492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e6da-eea7-431b-87fc-cce15d22e1ed None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:35.013964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e6da-eea7-431b-87fc-cce15d22e1ed None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:35.018370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:35.019007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:35.019284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:35.019585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:35.029587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:35.031019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eebd8e-4edf-4e4d-a748-21885f5ee682 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:35.041429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 746/1490] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:34:37.422879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d59e6-96e9-4ada-a04b-c8b922c7da5f None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:37.423500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d59e6-96e9-4ada-a04b-c8b922c7da5f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:37.423500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d59e6-96e9-4ada-a04b-c8b922c7da5f None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:37.424822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 745/1491] 10.222.0.23 () {54 vars in 926 bytes} [Wed May 4 21:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:34:37.431060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524617-0024-4cca-9ae9-80606fa853e9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:37.431857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524617-0024-4cca-9ae9-80606fa853e9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:37.432029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e524617-0024-4cca-9ae9-80606fa853e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:37.453654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2e524617-0024-4cca-9ae9-80606fa853e9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:34:37.455156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2e524617-0024-4cca-9ae9-80606fa853e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:34:37.463688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 747/1492] 10.222.0.23 () {58 vars in 1023 bytes} [Wed May 4 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:34:37.505100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d59e6-96e9-4ada-a04b-c8b922c7da5f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:34:37.517239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d59e6-96e9-4ada-a04b-c8b922c7da5f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:34:37.520837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:34:37.521471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:34:37.521752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:34:37.522025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:34:37.532073 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:34:37.533510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825f05-0336-4fcd-9f25-589b190d2d73 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:34:37.543174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 746/1493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:36:10.500212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.501150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.501150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.522017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:10.523155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:10.532326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 748/1494] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:36:10.541120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.541633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.541741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.563758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:10.564950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:10.574473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 747/1495] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:36:10.580668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.590601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2bbc-39b0-4989-b79c-688daeae7595 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.595500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.596142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.596418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.596686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.597408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:36:10.597738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.598807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.598807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:36:10.598807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:36:10.599708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.611086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 749/1496] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:36:10.619253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.628032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92240108-4844-4b3b-8843-f9dcb032d8f8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.632962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.633602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.633876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.634146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.634826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.636655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.636655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:36:10.636655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:36:10.638071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.678691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 748/1497] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:36:10 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:36:10.683092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.693794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0f883-aabd-43a3-828d-688d32946221 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.754153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.755126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.755480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.755842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.756843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.758392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.758392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:36:10.758392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:36:10.760192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.787628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 750/1498] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:36:10 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:36:10.791681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.802783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f43b-673f-4088-ba43-b7d6b5c4be8d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.808938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.809603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.809883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.810152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.810868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.811974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.811974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:36:10.811974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:36:10.812884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.828969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 749/1499] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:36:10.833293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.843556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8257908-3c95-4683-ae5e-11162ac942af admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.848984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.849635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.849911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.850179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.850898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.851937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.851937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:36:10.851937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:36:10.852819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683b2f9-c3d4-409a-abc2-d5cdfb339e05 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.866307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 751/1500] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:36:10.870375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:10.880573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65213f-ca4d-464c-b244-dd4bff276425 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:10.885753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:10.886623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.886899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.887194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] PATH_INFO: `/v3/projects/d682b2f1254d40e6a3d5eee032a20528/users/1c4cc675aee84c64baaec03c342b31c3/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.902754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d682b2f1254d40e6a3d5eee032a20528, user_id=1c4cc675aee84c64baaec03c342b31c3, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:10.903831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:10.903831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:36:10.903831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:36:10.905754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:10.921996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 750/1501] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:36:10 2022] PUT /identity/v3/projects/d682b2f1254d40e6a3d5eee032a20528/users/1c4cc675aee84c64baaec03c342b31c3/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:36:10.933479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c8ae-3244-4172-8106-90b4ed527f6c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:10.933762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c8ae-3244-4172-8106-90b4ed527f6c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:10.934032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901c8ae-3244-4172-8106-90b4ed527f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:10.963677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c901c8ae-3244-4172-8106-90b4ed527f6c None None] MFA Rules not processed for user `1c4cc675aee84c64baaec03c342b31c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:10.964889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c901c8ae-3244-4172-8106-90b4ed527f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:11.027358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 752/1502] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:36:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:36:11.038604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:11.111476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d334-3785-4eaa-9309-0bd6d5237272 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:11.117428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:11.118068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.118314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.119222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.127195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:11.128812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:11.137574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 751/1503] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:36:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:36:11.216674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a45e17-79dc-46d8-8ad7-9600b44824d7 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.216959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a45e17-79dc-46d8-8ad7-9600b44824d7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.217227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a45e17-79dc-46d8-8ad7-9600b44824d7 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.218521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 753/1504] 10.222.0.23 () {52 vars in 829 bytes} [Wed May 4 21:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:36:11.223348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:11.289565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb467dc0-7599-4401-9361-4b8410021879 service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:11.295679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:11.296560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.296835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.297102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] PATH_INFO: `/v3/users/1c4cc675aee84c64baaec03c342b31c3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.298369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4cc675aee84c64baaec03c342b31c3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:11.299417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:11.299417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:36:11.299417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:36:11.300645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:11.372326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4cc675aee84c64baaec03c342b31c3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:11.390160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4cc675aee84c64baaec03c342b31c3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:11.402908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4cc675aee84c64baaec03c342b31c3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:11.403764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4cc675aee84c64baaec03c342b31c3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:11.414868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4cc675aee84c64baaec03c342b31c3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:11.421331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 752/1505] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:36:11 2022] DELETE /identity/v3/users/1c4cc675aee84c64baaec03c342b31c3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:36:11.427196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.427644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.427955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.445961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:36:11.447179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:11.507094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 754/1506] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:36:11.519341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:11.521784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:11.586855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ec9af-7af2-4afc-958f-ce91ad05bead admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:11.591004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:11.591682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.591960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.592230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.601467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:11.602895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47863cf-31a3-4f1c-b4c4-18596e047b11 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:11.612419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 753/1507] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:36:11.939477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:36:11.941354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:36:11.955635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9477163-b9e7-4637-8bd7-06e7261c9c1c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:36:11.961641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:36:11.962511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:36:11.962793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:36:11.963069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] PATH_INFO: `/v3/projects/d682b2f1254d40e6a3d5eee032a20528` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:36:11.964319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d682b2f1254d40e6a3d5eee032a20528)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:36:11.965341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:36:11.965341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:36:11.965341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:36:11.966546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:36:12.028034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd682b2f1254d40e6a3d5eee032a20528', 'request_id': 'req-86ed562d-8f96-432c-86fb-c7a6286cf0b9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:12.033809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd682b2f1254d40e6a3d5eee032a20528', 'request_id': 'req-86ed562d-8f96-432c-86fb-c7a6286cf0b9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:12.047113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd682b2f1254d40e6a3d5eee032a20528', 'request_id': 'req-86ed562d-8f96-432c-86fb-c7a6286cf0b9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:12.061622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] The token cache is being invalidate because project d682b2f1254d40e6a3d5eee032a20528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:36:12.061905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:12.062547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-86ed562d-8f96-432c-86fb-c7a6286cf0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:36:12.064275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 755/1508] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:36:11 2022] DELETE /identity/v3/projects/d682b2f1254d40e6a3d5eee032a20528 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:37:54.692190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:54.692817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:54.692817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:54.694191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 754/1509] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:37:54.700146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7403-641b-4f28-af16-206889f69b96 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:54.700887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7403-641b-4f28-af16-206889f69b96 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:54.701046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e7403-641b-4f28-af16-206889f69b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:54.728841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-da6e7403-641b-4f28-af16-206889f69b96 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:37:54.730048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da6e7403-641b-4f28-af16-206889f69b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:37:54.788814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 756/1510] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:37:54.940584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:54.944006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:37:55.024745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2e4e5-d138-406b-9e6d-793f0e9fb27f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:55.031919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:55.032555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:55.032840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:55.033108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:55.041457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:55.043039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf62424-67bc-4f8b-a084-3280a9dec5a8 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:55.052323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 755/1511] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:37:55.306252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3affc-d745-4b9f-9dc2-92c28ac8b9ba None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:55.306530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3affc-d745-4b9f-9dc2-92c28ac8b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:55.306820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3affc-d745-4b9f-9dc2-92c28ac8b9ba None None] PATH_INFO: `/v3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:55.308255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 757/1512] 10.222.0.21 () {54 vars in 925 bytes} [Wed May 4 21:37:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:37:55.314903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744c35-fea5-4ddb-b303-763fa7d1015f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:55.315187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744c35-fea5-4ddb-b303-763fa7d1015f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:55.315488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e744c35-fea5-4ddb-b303-763fa7d1015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:55.334329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9e744c35-fea5-4ddb-b303-763fa7d1015f None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:37:55.335532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9e744c35-fea5-4ddb-b303-763fa7d1015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:37:55.398480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 756/1513] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 21:37:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:37:56.275748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fe17-deea-4270-ba5b-1bd2586a597f None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:56.276567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fe17-deea-4270-ba5b-1bd2586a597f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:56.276567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64fe17-deea-4270-ba5b-1bd2586a597f None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:56.278682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:37:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:37:56.285415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd4380-e43d-4468-9b72-1501b1cb31b1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:56.285823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd4380-e43d-4468-9b72-1501b1cb31b1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:56.285963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd4380-e43d-4468-9b72-1501b1cb31b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:56.311710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-63dd4380-e43d-4468-9b72-1501b1cb31b1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:37:56.312832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-63dd4380-e43d-4468-9b72-1501b1cb31b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:37:56.321146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:37:56.478898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64fe17-deea-4270-ba5b-1bd2586a597f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:37:56.499205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e64fe17-deea-4270-ba5b-1bd2586a597f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:37:56.505646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:37:56.506282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:37:56.506563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:37:56.506836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:37:56.514920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:37:56.516557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36efa065-828e-4d3a-b986-af12ed399863 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:37:56.525970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 759/1516] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:04.573355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a686-a306-4b22-a9a1-f10b2b3f07eb None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:04.574193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a686-a306-4b22-a9a1-f10b2b3f07eb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:04.574193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208a686-a306-4b22-a9a1-f10b2b3f07eb None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:04.576475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 758/1517] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:04.582409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833396ff-6751-43ce-b5d4-42ae6104ca17 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:04.583147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833396ff-6751-43ce-b5d4-42ae6104ca17 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:04.583592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833396ff-6751-43ce-b5d4-42ae6104ca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:04.603350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-833396ff-6751-43ce-b5d4-42ae6104ca17 None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:04.604574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-833396ff-6751-43ce-b5d4-42ae6104ca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:04.613917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 760/1518] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:38:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:04.621675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a686-a306-4b22-a9a1-f10b2b3f07eb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:04.636792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208a686-a306-4b22-a9a1-f10b2b3f07eb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:04.642463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:04.643083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:04.643370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:04.643670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:04.652169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:04.653757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924ddc1-c5b0-453e-ad37-e03e4ec345b0 service placement] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:04.663286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 759/1519] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:08.169296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf1a-6e7b-4eff-b3b2-35b237a66c3b None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:08.170186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf1a-6e7b-4eff-b3b2-35b237a66c3b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:08.170186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1cf1a-6e7b-4eff-b3b2-35b237a66c3b None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:08.172499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 761/1520] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:38:08.180602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b554-d07f-4406-a205-3a9c31512b5e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:08.181037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b554-d07f-4406-a205-3a9c31512b5e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:08.181214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b554-d07f-4406-a205-3a9c31512b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:08.201476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b282b554-d07f-4406-a205-3a9c31512b5e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:08.202651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b282b554-d07f-4406-a205-3a9c31512b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:08.211276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 760/1521] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:08.361407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1cf1a-6e7b-4eff-b3b2-35b237a66c3b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:08.378183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1cf1a-6e7b-4eff-b3b2-35b237a66c3b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:08.388978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:08.389878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:08.390289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:08.390683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:08.401917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:08.403546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e21c3-99b0-4304-8db1-67ccc0552201 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:08.413086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 762/1522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:09.617033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b68a-ae2a-4365-925d-8b930b8df1d6 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:09.617595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b68a-ae2a-4365-925d-8b930b8df1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:09.617735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8b68a-ae2a-4365-925d-8b930b8df1d6 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:09.619407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 761/1523] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 4 21:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:09.626503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b655eb-69df-4350-8160-1ba9cef6cc54 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:09.627216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b655eb-69df-4350-8160-1ba9cef6cc54 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:09.627324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b655eb-69df-4350-8160-1ba9cef6cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:09.646707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-20b655eb-69df-4350-8160-1ba9cef6cc54 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:09.647952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-20b655eb-69df-4350-8160-1ba9cef6cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:09.657103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 763/1524] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 4 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:09.812769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b68a-ae2a-4365-925d-8b930b8df1d6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:09.829336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8b68a-ae2a-4365-925d-8b930b8df1d6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:09.836651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:09.837284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:09.837563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:09.837838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:09.845983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:09.847595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d765c08-e998-458e-a351-718308bf5b40 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:09.856949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 762/1525] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:14.014647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.015275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.015275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.016627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 764/1526] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:14.021956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24c75-474c-4c8b-ad65-5919e81f5e44 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.022805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24c75-474c-4c8b-ad65-5919e81f5e44 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.023297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d24c75-474c-4c8b-ad65-5919e81f5e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.043002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-73d24c75-474c-4c8b-ad65-5919e81f5e44 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:14.044223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-73d24c75-474c-4c8b-ad65-5919e81f5e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.052460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 763/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:14.089956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:14.092897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:14.170485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83abad4-c6c3-450c-9c1b-71a1f3797002 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:14.175017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:14.175695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:14.175975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:14.176242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:14.187765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:14.189207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764300f2-864d-4760-88dd-9f9d508cbe71 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:14.199288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 765/1528] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:16.381038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ac75-85f2-474e-a2a2-bed9196b8577 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:16.381615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ac75-85f2-474e-a2a2-bed9196b8577 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:16.381615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990ac75-85f2-474e-a2a2-bed9196b8577 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:16.382874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 764/1529] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:16.389174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b920e-a3f4-4e8c-8343-e8eaeab18840 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:16.389919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b920e-a3f4-4e8c-8343-e8eaeab18840 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:16.390026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b920e-a3f4-4e8c-8343-e8eaeab18840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:16.417109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3c8b920e-a3f4-4e8c-8343-e8eaeab18840 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:16.418309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3c8b920e-a3f4-4e8c-8343-e8eaeab18840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:16.428122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 766/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:16.464493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ac75-85f2-474e-a2a2-bed9196b8577 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:16.480910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990ac75-85f2-474e-a2a2-bed9196b8577 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:16.485518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:16.486150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:16.486404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:16.486694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:16.496281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:16.497711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaa49ca-275a-4efe-a8dd-15579ba52cd5 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:16.506974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 765/1531] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:20.185887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:20.186801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:20.186801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:20.189031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 767/1532] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:20.194429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90147536-41ea-4396-9c3f-ff16754d98ab None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:20.194893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90147536-41ea-4396-9c3f-ff16754d98ab None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:20.195005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90147536-41ea-4396-9c3f-ff16754d98ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:20.213367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-90147536-41ea-4396-9c3f-ff16754d98ab None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:20.214547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-90147536-41ea-4396-9c3f-ff16754d98ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:20.223164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 766/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:20.497216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:20.500127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:20.566492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac8dff-63a4-4d46-b7f7-6daad941ad90 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:20.570195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:20.570842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:20.571123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:20.571407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:20.580332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:20.581758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ab493-ae90-435b-8dda-dd31a5daefa9 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:20.591714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 768/1534] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:38:22.878139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be163-5f0e-4b32-9064-e350573b208a None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:22.878657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be163-5f0e-4b32-9064-e350573b208a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:22.878741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2be163-5f0e-4b32-9064-e350573b208a None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:22.880210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 767/1535] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 4 21:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:22.885753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caad0-28a7-4036-a26a-fe8049a9dc2e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:22.886198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caad0-28a7-4036-a26a-fe8049a9dc2e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:22.886300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9caad0-28a7-4036-a26a-fe8049a9dc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:22.904761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ad9caad0-28a7-4036-a26a-fe8049a9dc2e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:22.905963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ad9caad0-28a7-4036-a26a-fe8049a9dc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:22.915209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 769/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 4 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:23.191251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6686d-d5aa-48ce-9d74-d1a70d3a972e None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:23.191831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6686d-d5aa-48ce-9d74-d1a70d3a972e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:23.192255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6686d-d5aa-48ce-9d74-d1a70d3a972e None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:23.194136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 768/1537] 10.222.0.23 () {54 vars in 963 bytes} [Wed May 4 21:38:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:38:23.199074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956784b7-a84f-4325-8d0b-f7040002bece None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:23.199362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956784b7-a84f-4325-8d0b-f7040002bece None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:23.199733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956784b7-a84f-4325-8d0b-f7040002bece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:23.218341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-956784b7-a84f-4325-8d0b-f7040002bece None None] MFA Rules not processed for user `93f8c6e46f6d4cc8a3364bfa3e6b93d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:38:23.219534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-956784b7-a84f-4325-8d0b-f7040002bece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:38:23.227407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 770/1538] 10.222.0.23 () {58 vars in 1060 bytes} [Wed May 4 21:38:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:38:23.234705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6686d-d5aa-48ce-9d74-d1a70d3a972e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:38:23.247130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6686d-d5aa-48ce-9d74-d1a70d3a972e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:38:23.251359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:38:23.252036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:38:23.252298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:38:23.252594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:38:23.261852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:38:23.263295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a51f66-25f9-4baf-b784-703024264041 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:38:23.273005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 769/1539] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:54.958917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b9ca-269c-46c1-8e9d-536ca5e1ee19 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:54.959586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b9ca-269c-46c1-8e9d-536ca5e1ee19 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:54.959586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556b9ca-269c-46c1-8e9d-536ca5e1ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:54.981362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7556b9ca-269c-46c1-8e9d-536ca5e1ee19 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:54.982583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7556b9ca-269c-46c1-8e9d-536ca5e1ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.000541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 771/1540] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.013840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe191e3-7db6-4e36-8496-b4ef6354c012 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.014893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe191e3-7db6-4e36-8496-b4ef6354c012 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.015443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe191e3-7db6-4e36-8496-b4ef6354c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.023901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56344-1f5a-4a12-8b02-56d0d071bb65 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.023901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56344-1f5a-4a12-8b02-56d0d071bb65 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.023901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e56344-1f5a-4a12-8b02-56d0d071bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.043409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0fe191e3-7db6-4e36-8496-b4ef6354c012 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.045830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0fe191e3-7db6-4e36-8496-b4ef6354c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.052578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-20e56344-1f5a-4a12-8b02-56d0d071bb65 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.053787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-20e56344-1f5a-4a12-8b02-56d0d071bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.064890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 770/1541] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.066642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.067322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.070263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.073146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 772/1542] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:39:55.074645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30aff-afaf-4a67-9430-667bdcc3833f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.074928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30aff-afaf-4a67-9430-667bdcc3833f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.075202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a30aff-afaf-4a67-9430-667bdcc3833f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.096014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.097716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.116267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 771/1543] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.117518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.124598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-01a30aff-afaf-4a67-9430-667bdcc3833f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.125802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-01a30aff-afaf-4a67-9430-667bdcc3833f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.134391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3b867-41dd-4049-a900-3bf62038bd70 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.142457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.143413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.143934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.144636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.145713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.146265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.147655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 04 21:39:55.147655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:39:55.147655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:39:55.148956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d03320-30e2-41f2-851d-b564043631fd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.152813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 773/1544] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.154120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8508-e011-476e-8695-983a53347911 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.159477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8508-e011-476e-8695-983a53347911 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.159477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf8508-e011-476e-8695-983a53347911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.168253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 772/1545] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.169878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6109-f22c-4ee4-8304-534549f818e7 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.170703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6109-f22c-4ee4-8304-534549f818e7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.171217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb6109-f22c-4ee4-8304-534549f818e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.192528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a8cf8508-e011-476e-8695-983a53347911 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.193734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a8cf8508-e011-476e-8695-983a53347911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.195000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-92cb6109-f22c-4ee4-8304-534549f818e7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.196419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-92cb6109-f22c-4ee4-8304-534549f818e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.210232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 773/1546] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.212825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.215713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 774/1547] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.217329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3282c7-4594-4494-a953-408e7204006d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.217711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.218278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.220296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3282c7-4594-4494-a953-408e7204006d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.220838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3282c7-4594-4494-a953-408e7204006d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.250063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.252102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.264493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-be3282c7-4594-4494-a953-408e7204006d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.266184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 774/1548] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.266184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.266395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-be3282c7-4594-4494-a953-408e7204006d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.275141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 775/1549] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.275846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198139-80ad-4165-98ed-8fa4eb935228 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.276259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3282c7-4594-4494-a953-408e7204006d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.286171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.286932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.287285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.287667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.288492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.288813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3282c7-4594-4494-a953-408e7204006d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.290742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3d72-627b-4d3f-b23a-03dc23632086 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.293565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.294213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.294489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.294757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.295511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.295812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.297397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.310047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 776/1550] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.310739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.321161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91e7b2-6f58-426b-a360-4f167ccaeb8f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.326200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 775/1551] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.326405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.328157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.328157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.328157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.328484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.328484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.328640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.328723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.328804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.330421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3163eaeb-7ac8-4be8-8193-7e2d91e40764 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.348756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.349790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 777/1552] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.350096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.351350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b470ac-3f7d-4255-b0ba-3ca7100e41f9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.351665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b470ac-3f7d-4255-b0ba-3ca7100e41f9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.351945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b470ac-3f7d-4255-b0ba-3ca7100e41f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.369097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d2b470ac-3f7d-4255-b0ba-3ca7100e41f9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.370295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d2b470ac-3f7d-4255-b0ba-3ca7100e41f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.405762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 776/1553] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.406631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.415700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077918-3add-4db7-b381-35b43c12b948 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.420176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.420821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.421098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.421366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.422081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.422375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.423971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.429424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 778/1554] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.430719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.431003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.431277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.435629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 777/1555] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.436455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.445889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979f075-149a-4e8a-ba36-6607b184b588 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.450539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.451168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.451492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.451763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.452439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.453158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.454308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8362100f-8690-4fa2-b78e-c8cccfd681f9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.454448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.462809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 779/1556] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.463548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.473349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad285a-e6be-4213-b31f-0f18054ce44f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.478815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.479560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.479841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.480116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.480836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.483048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.483173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 778/1557] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.484350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e0063-df58-4c08-9a05-6f6a3d7d0eb9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.484623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e0063-df58-4c08-9a05-6f6a3d7d0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.484895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0e0063-df58-4c08-9a05-6f6a3d7d0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.505695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 780/1558] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/users => generated 290 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.505891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8f0e0063-df58-4c08-9a05-6f6a3d7d0eb9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.506009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.506110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8f0e0063-df58-4c08-9a05-6f6a3d7d0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.513179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85df9b6-bbd9-455d-b52c-130a1135932b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.561445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 779/1559] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.562726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6169-d780-43d5-9f6c-238c9f26ccb0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.563010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6169-d780-43d5-9f6c-238c9f26ccb0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.563278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6169-d780-43d5-9f6c-238c9f26ccb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.567846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.568713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.569160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.569581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.570433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.571474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:39:55.571474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:39:55.571474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:39:55.572703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.580638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8cdc6169-d780-43d5-9f6c-238c9f26ccb0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.582192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8cdc6169-d780-43d5-9f6c-238c9f26ccb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.591143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 780/1560] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.592621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.592940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.593214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.603049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 781/1561] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.603049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.612298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.613542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.661208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c23d57-8315-403b-82d2-e933d02d9cbb admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.665866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.666521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.666800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.667045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.667764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.669007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 781/1562] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.669694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.670007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.679130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab0c-f874-4fbc-ab0c-7abaab64b976 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.683906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.684539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.684808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.685077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.686003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.686324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.688091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.695275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 782/1563] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.696148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.701836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 782/1564] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.702753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.712346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d51e33-dcf1-4a28-be24-a6a031c27bdc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.757391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ed631f-36b1-44e6-be36-dcf2052baaa9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.762042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.762702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.762981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.763251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.763967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.765887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.768510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.769184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.769571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.769849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.770573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.772188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbfc34-ae9b-44fd-9b2f-94578d0b5e07 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.782670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 783/1565] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:55.783958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.784230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.784502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.786679 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 783/1566] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.787576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.796639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e993b53-6a88-4502-ae77-1885bdc1afe1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.801862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.802509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.802786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.803054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.803505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:55.803856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.804391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.804883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:55.806907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.815126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 784/1567] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:55.815959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.825452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 784/1568] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.826011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52029fe4-cd73-4de2-aa24-fd5f268d9dfc None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.826122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.831533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.832566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.832854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.833170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.833810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.834832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:39:55.834832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:39:55.834832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:39:55.836091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.836732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2236ec-7db2-471d-b7bc-c0f8ed713185 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.841204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.841839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.842115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.842380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.843091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:55.843433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.844984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.863756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 785/1569] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:55.863964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 785/1570] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.864063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.864156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.870903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9f6fb-7916-4197-b74e-eae86985a51b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.873375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab6d9c-1f52-41d1-913f-f93a087908fd admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.875510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.876170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.876429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.876708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.877403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.878069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.878711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.879063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.879337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.879457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.880045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.881903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.906990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 786/1571] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.906990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.907311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 786/1572] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:55.907311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.914843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1caa-6c6c-4e42-a533-057d446fefca admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.970403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d82c58-7048-467b-a276-9128fff1bf96 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:55.974894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.975214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:55.975716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.975848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.975982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:55.976121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.976216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:55.976423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:55.976846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.977144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:55.978445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.978741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:55.987948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 787/1573] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:55.991805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 787/1574] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:55.991968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.992082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:55.999968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd219fd3-88ee-4d44-ba14-d702bb3bd67b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.000763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a36e2-3de9-4f58-baa7-ad691e560c34 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.004592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.005243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.005351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.005518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.005791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.005950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.006233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.006457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.006560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.007234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:39:56.007623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.008352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.009133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.020713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 788/1575] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:39:56.020713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.030855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bca031-f5f8-45df-9d4d-77967d0815ba admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.035692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.036368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.036611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.036881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.037600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.039178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.045311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 788/1576] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:55 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.045311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.052688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 789/1577] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.052688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.060082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cb9db2-2e0b-476c-b096-fcec241c1940 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.110037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a74eb-48ff-4e89-8c29-74e0bf6da985 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.114561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.115218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.115530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.115803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.116503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.117026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.117696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.117977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.118250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.118374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.118972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.120631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.133491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 790/1578] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.133491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.144054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3e29e-cf44-483e-be12-8607621f58c3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.153561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 789/1579] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/projects => generated 403 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.153811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.154002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.154176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.154176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.154176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.154176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.154176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.177510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 791/1580] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.179002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.189063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d190567-0c6c-406b-996c-75d3c67ccd99 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.220804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4437a5-4c8c-493b-ad6c-35f4e63c10cc admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.225358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.226258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.226517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.226787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] PATH_INFO: `/v3/projects/7b9fa6a05dcd47eb8fd05a41a757bc8a/users/c7ebe69827a64b8b86a9665b884a189a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.244756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9fa6a05dcd47eb8fd05a41a757bc8a, user_id=c7ebe69827a64b8b86a9665b884a189a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.245297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.245812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:39:56.245812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:39:56.245812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:39:56.246102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.246214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.246517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.247246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.247824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.248848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.259577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 792/1581] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.260468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.264896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 790/1582] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/7b9fa6a05dcd47eb8fd05a41a757bc8a/users/c7ebe69827a64b8b86a9665b884a189a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:56.265738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.270228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c925bdb-674d-4a4a-9525-f43f0fa0486d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.322827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.323546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.323943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.324220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.324320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa42914-1128-4fff-a5ef-32bc028bbd2d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.324898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.326803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.328882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.329539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.329813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.330082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.330758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.333108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.353022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 793/1583] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.356203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 791/1584] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.356960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.357164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.366132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c08880-281b-48b3-bd74-fad26a0a1cf9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.415736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3720cb-8a20-43ba-9141-3f92c3a1f410 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.418116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.418783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.419061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.419434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.420089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.420750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.421412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.421651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.421748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.421942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.422664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.424278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.431631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 792/1585] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.432464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.434378 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 794/1586] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.434992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.441801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817b54-fc88-4223-bdaa-af84b57f7781 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.444648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880f747-d0bd-45bc-9880-900efd1b6339 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.446307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.446988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.447265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.447569 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.448246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.449769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.450107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5ad1d-352a-4ee5-a386-79d2bf61e708 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.450416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.450727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.451031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.451813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.453419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.465182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 795/1587] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.466175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.472156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 793/1588] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/users => generated 302 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.474279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.474564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.474840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.480204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a093a31-e2c3-4f62-9de9-28014423125b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.486958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.487906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.488501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.488621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] PATH_INFO: `/v3/projects/80373b242ff34b0ba8ac77e122566e67/users/4b47d6eb074c484d8d8dd5552783d4d0/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.493634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:56.494825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:56.503216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 794/1589] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:56.504120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.506842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80373b242ff34b0ba8ac77e122566e67, user_id=4b47d6eb074c484d8d8dd5552783d4d0, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.509718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.513186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a2a15-b19a-45ff-a151-693e16c5e022 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.521191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.522062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.522306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.522652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.523483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.524986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 796/1590] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/80373b242ff34b0ba8ac77e122566e67/users/4b47d6eb074c484d8d8dd5552783d4d0/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:56.525874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.527682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.538293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 795/1591] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.539096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.548788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c01ba-d478-4d9c-bc33-a560c31733a4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.591692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9080c6f-8bf6-4be8-a936-a530d5a8b3f1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.596279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.597087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.597357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.597690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.598400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.600354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.604198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.605091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.605389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.605640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] PATH_INFO: `/v3/projects/4cdbf9d036b4410b81ef59b92ef8e56c/users/7561c16d63774763b61bffd087aa6307/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.623053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 797/1592] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:56.623295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdbf9d036b4410b81ef59b92ef8e56c, user_id=7561c16d63774763b61bffd087aa6307, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.623295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.624446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.635032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e2479-21bc-4353-99f1-0e1ce43dfb75 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.637411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 796/1593] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/4cdbf9d036b4410b81ef59b92ef8e56c/users/7561c16d63774763b61bffd087aa6307/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:56.638401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.687488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.688420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.688701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.688974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] PATH_INFO: `/v3/projects/a65a81c528934038a20f3aa6c14df2d4/users/52bb58aee3884ff4bf518a50f152c63a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.695003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b7f66-737c-4578-b184-244c7905c017 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.700125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.700791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.701072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.701346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.702073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.702594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65a81c528934038a20f3aa6c14df2d4, user_id=52bb58aee3884ff4bf518a50f152c63a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.703798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.705288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.714642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 797/1594] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.715343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.720205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 798/1595] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/a65a81c528934038a20f3aa6c14df2d4/users/52bb58aee3884ff4bf518a50f152c63a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:56.720997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.726841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393881-4ee7-49cb-be03-03456c3e61db admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.780225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d96f9-1151-41bf-9eb2-cefb302b4dc9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.783818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.783978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.784445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.784595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.784713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.784807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.785035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.785144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.786647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.788652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2f7c5-c90a-4aa9-b641-dfaacc76047f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.794149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.795598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.799644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 798/1596] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.800939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.801224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.802122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.805115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 799/1597] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:56.805873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.814675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93d549-9c36-44c9-9969-29331cbbeeda service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.819321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.819934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:56.820056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.820501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.820793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.821366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:56.821487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.823094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409a58d-c3b3-4677-adee-bc160ef9121c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.829552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 799/1598] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:56.830531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.835095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 800/1599] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.836070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9403e0-0cbf-4c76-86ea-117d6eac0eea None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.836447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9403e0-0cbf-4c76-86ea-117d6eac0eea None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.836782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9403e0-0cbf-4c76-86ea-117d6eac0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.842849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834247f-315a-4b78-86dc-2efb776b31a7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.847591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.848271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.848533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.848851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.850077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.851720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.856870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6e9403e0-0cbf-4c76-86ea-117d6eac0eea None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:56.858141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6e9403e0-0cbf-4c76-86ea-117d6eac0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:56.862357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 800/1600] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:56.865943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.867510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 801/1601] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:56.869057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.869601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.869908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.875636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8e301-1c30-4bec-aaed-7e4e1ba33ef3 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.880296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.881196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.881476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.881749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] PATH_INFO: `/v3/projects/3b05fdea4cf3422d991c8cb98cafe373/users/c9109b244aef49a1a29050bb055c0ba2/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.897386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b05fdea4cf3422d991c8cb98cafe373, user_id=c9109b244aef49a1a29050bb055c0ba2, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.900134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.900346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] MFA Rules not processed for user `52bb58aee3884ff4bf518a50f152c63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:56.901513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:56.916624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 801/1602] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/3b05fdea4cf3422d991c8cb98cafe373/users/c9109b244aef49a1a29050bb055c0ba2/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:56.917500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.978569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 802/1603] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:56.979612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:56.987514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7df17-8b4c-4c86-8973-3703d12de5f8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.989911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea8e84-3b24-47af-9ac6-a86c547ff3f2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:56.992587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.993398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.993797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.994208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:56.994978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:56.995540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:56.996436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:56.996740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:56.997000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:56.997126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] PATH_INFO: `/v3/projects/004cd813ea584b699231235e3d46c717/users/2228b96f4ac94d41acc3329baf22fc3c/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.010437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 802/1604] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:57.010437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.012599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:57.013394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=004cd813ea584b699231235e3d46c717, user_id=2228b96f4ac94d41acc3329baf22fc3c, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.016211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.039732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 803/1605] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:56 2022] PUT /identity/v3/projects/004cd813ea584b699231235e3d46c717/users/2228b96f4ac94d41acc3329baf22fc3c/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:57.039732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.076349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846d58c-f306-43f5-a930-d665d75bfab7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.101720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315effc8-c3db-4e5f-b37b-f3aac58d3d03 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.107129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.107851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.108180 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.108458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.109194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.110868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.124844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 804/1606] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:57.124844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.136855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.138068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.138575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.138941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.164600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.166124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40850b1a-dd9e-4696-9828-f682778b0fef service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.177625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 803/1607] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:57.178998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.179287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.179584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.184064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc1aa3-c1a7-4afa-9075-ebda9353427d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.188541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.189325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.189660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.190041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.198292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:57.199429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:57.206337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.208656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.210566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 804/1608] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:57.214123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.220311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 805/1609] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:57.221130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.225466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de72989-c3ab-4861-874c-ecc5cdea07d1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.231218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245da3-ac1f-4fd6-b6dd-56e16afce9ce service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.232201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.233210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.233960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.234382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.235554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.236618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.237718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.238649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.238907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] PATH_INFO: `/v3/projects/9db0f3b8801b411eb52d06a256461ced/users/90496a0cfd794101977371bc91435551/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.243022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.261875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db0f3b8801b411eb52d06a256461ced, user_id=90496a0cfd794101977371bc91435551, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.264811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b372acd-f387-439c-acc6-26b5d899cf8a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.295578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 806/1610] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:57 2022] PUT /identity/v3/projects/9db0f3b8801b411eb52d06a256461ced/users/90496a0cfd794101977371bc91435551/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:57.296069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 805/1611] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:57.296069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.296413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.296413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.296413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.328102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] MFA Rules not processed for user `2228b96f4ac94d41acc3329baf22fc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:57.329517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:57.373566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a74a84-1795-4822-9feb-2dafc8e98e23 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.382191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.383321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.383766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.384217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] PATH_INFO: `/v3/projects/4762ea76ada249ff9dc089f9b323263a/users/36ab1932fad74b32b5f46f7ee7717c4e/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.405651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4762ea76ada249ff9dc089f9b323263a, user_id=36ab1932fad74b32b5f46f7ee7717c4e, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.409078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.428167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 806/1612] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:57 2022] PUT /identity/v3/projects/4762ea76ada249ff9dc089f9b323263a/users/36ab1932fad74b32b5f46f7ee7717c4e/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:57.428448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 807/1613] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:57.429413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.429545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.442125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba33ed-9994-4878-abb7-2d382b935e26 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.503502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec04a6-7a2e-4480-a39c-0949002e786c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.508059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.508722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.509003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.509282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.516588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.517494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.517916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.518194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.518887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.521425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e1fb6-5201-4c0f-a2db-bfe72ae209ca admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.549513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 808/1614] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:57.549513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.549513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.549513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.575468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.577044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1ff4c-8e23-4e3d-9bb7-e387d1ee8704 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.579415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] MFA Rules not processed for user `90496a0cfd794101977371bc91435551`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:57.580604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:57.587717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 807/1615] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:57.599969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.603037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.603441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.637171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] MFA Rules not processed for user `36ab1932fad74b32b5f46f7ee7717c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:57.640231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:57.688831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 809/1616] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:57.690330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.730457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 808/1617] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:57.731673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.747070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef5976-3639-41d4-933d-fca30220f262 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.752925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.754027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.754759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.755187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.756632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.758399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.770462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 809/1618] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:57.771916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.779072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0783e2-2a18-406d-989b-60cd6a62cd79 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.785236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.785834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb4d8f-1a40-4333-95b0-dfaad2e2b1eb admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.786409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.787127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.787588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.793146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.794494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.794843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.795183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.795987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.798483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea0b06-f9ec-46bf-83b0-cbc8304a6abb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.832428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 810/1619] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:57.834058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9494-5652-4cfb-8b9e-43d0385aa874 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.834461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9494-5652-4cfb-8b9e-43d0385aa874 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.834995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a9494-5652-4cfb-8b9e-43d0385aa874 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.836267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 811/1620] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:57.837223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9494-5652-4cfb-8b9e-43d0385aa874 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.872939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.875323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:57.895207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 810/1621] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:57.896163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:57.913719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6cec5-2224-4538-b7ee-d27dae09beb5 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.964168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a9494-5652-4cfb-8b9e-43d0385aa874 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:57.970589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:57.971859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:57.972434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:57.972944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] PATH_INFO: `/v3/projects/c1d1d38807e0408e88610b194f319232/users/49335609c3684ef2a2c575422ac1d425/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:57.991309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d1d38807e0408e88610b194f319232, user_id=49335609c3684ef2a2c575422ac1d425, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:57.995987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d81d68-2945-4e5c-9e34-f59cf0079659 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.000236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.001031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.001311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.001813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.002483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.005323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.027158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 812/1622] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:57 2022] PUT /identity/v3/projects/c1d1d38807e0408e88610b194f319232/users/49335609c3684ef2a2c575422ac1d425/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:58.028694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929962a6-d154-475c-8e92-d933015fb95a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.029046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929962a6-d154-475c-8e92-d933015fb95a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.029387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929962a6-d154-475c-8e92-d933015fb95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.046227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 811/1623] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:39:57 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:39:58.046227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.059327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28623442-869c-4bab-8ab3-ebddcafdc9d8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.065199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-929962a6-d154-475c-8e92-d933015fb95a None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:58.066407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-929962a6-d154-475c-8e92-d933015fb95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:58.130954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.131689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.131972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.132246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.132997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.134790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.152676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 812/1624] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:58.156532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.171186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b7ea0-ec12-49f1-83aa-c34627a76379 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.178168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.178874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.179154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.179453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.180252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.181996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.196141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 813/1625] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:58.197155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.211895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a55d95-67c4-4491-97c5-e966f22d1c49 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.213493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 813/1626] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:58.217828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.218843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.219126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.219416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] PATH_INFO: `/v3/projects/c1d1d38807e0408e88610b194f319232/users/49335609c3684ef2a2c575422ac1d425/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.221618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d1d38807e0408e88610b194f319232, user_id=49335609c3684ef2a2c575422ac1d425, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.221959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929962a6-d154-475c-8e92-d933015fb95a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.226157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.247912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929962a6-d154-475c-8e92-d933015fb95a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.256594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 814/1627] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:58 2022] PUT /identity/v3/projects/c1d1d38807e0408e88610b194f319232/users/49335609c3684ef2a2c575422ac1d425/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:58.257993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.384120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.386974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.388033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.389536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] PATH_INFO: `/v3/projects/53904d4fb6714924b3d6623473f6701a/users/ea9af23d37e141a89dca524b945b3a18/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.441881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53904d4fb6714924b3d6623473f6701a, user_id=ea9af23d37e141a89dca524b945b3a18, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.451421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a4d76-87d2-4d9d-9d94-98bce0cec0e9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.472207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 814/1628] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:58 2022] PUT /identity/v3/projects/53904d4fb6714924b3d6623473f6701a/users/ea9af23d37e141a89dca524b945b3a18/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:58.472421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1995ae-1f80-4efc-827b-d9b5d44097b8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.472529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.472529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.472529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.517373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] MFA Rules not processed for user `49335609c3684ef2a2c575422ac1d425`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:58.518589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:58.625067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.625761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.626089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.627075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.667050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 815/1629] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:58.668304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.760875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.764625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.789897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 815/1630] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:58.792541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.819423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff78d5d-ac13-4ab3-a7ca-2b375981976a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.832162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.833047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.833354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.833625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.834373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.836252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.862154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 816/1631] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:39:58.863527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:58.893853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bddf8b-a454-42e1-baeb-9d5587398f10 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.909573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:58.910593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.911330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.911330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] PATH_INFO: `/v3/projects/53904d4fb6714924b3d6623473f6701a/users/ea9af23d37e141a89dca524b945b3a18/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.915619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53904d4fb6714924b3d6623473f6701a, user_id=ea9af23d37e141a89dca524b945b3a18, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:58.918537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c13fe-064a-4cdd-b8a6-5d3aff688d5d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:58.939667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464569c-4a21-43ac-b017-79126851bf21 service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:58.960322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 817/1632] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:39:58 2022] PUT /identity/v3/projects/53904d4fb6714924b3d6623473f6701a/users/ea9af23d37e141a89dca524b945b3a18/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:39:58.961877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218623-a136-4999-96e0-81767b268c71 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:58.962165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218623-a136-4999-96e0-81767b268c71 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:58.962441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17218623-a136-4999-96e0-81767b268c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:58.993763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-17218623-a136-4999-96e0-81767b268c71 None None] MFA Rules not processed for user `c7ebe69827a64b8b86a9665b884a189a`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:58.995864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-17218623-a136-4999-96e0-81767b268c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.056909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:59.057575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.057853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.058123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.075685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 818/1633] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:59.075685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf617c07-ad8d-4417-b7d4-ab06336608a0 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.075685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf617c07-ad8d-4417-b7d4-ab06336608a0 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.075685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf617c07-ad8d-4417-b7d4-ab06336608a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.147942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:59.149418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d229ba-3bf0-4923-adce-7dffd3603b22 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:59.161024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 816/1634] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:59.162411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8766-50a8-4209-b031-c36a783ea4c4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.162736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8766-50a8-4209-b031-c36a783ea4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.163007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a8766-50a8-4209-b031-c36a783ea4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.171225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-cf617c07-ad8d-4417-b7d4-ab06336608a0 None None] MFA Rules not processed for user `ea9af23d37e141a89dca524b945b3a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:59.182914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-da4a8766-50a8-4209-b031-c36a783ea4c4 None None] MFA Rules not processed for user `c7ebe69827a64b8b86a9665b884a189a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:59.184801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-da4a8766-50a8-4209-b031-c36a783ea4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.188992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cf617c07-ad8d-4417-b7d4-ab06336608a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.204610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 817/1635] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:59.229829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa5f7-abfd-4a80-8aa0-77a73da22b9e None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.230126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa5f7-abfd-4a80-8aa0-77a73da22b9e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.230504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fa5f7-abfd-4a80-8aa0-77a73da22b9e None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.232771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 818/1636] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:39:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:39:59.253805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad54fb-4cde-461b-b95f-5313b66a6461 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.253805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad54fb-4cde-461b-b95f-5313b66a6461 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.253805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad54fb-4cde-461b-b95f-5313b66a6461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.296145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-54ad54fb-4cde-461b-b95f-5313b66a6461 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:59.299713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-54ad54fb-4cde-461b-b95f-5313b66a6461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.386085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 819/1637] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:59.387813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c82e-9163-4978-9017-5b7172ace6e5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.388949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c82e-9163-4978-9017-5b7172ace6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.399746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2c82e-9163-4978-9017-5b7172ace6e5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.403569 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 820/1638] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 21:39:59 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:39:59.404582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c82e-9163-4978-9017-5b7172ace6e5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:59.431428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2c82e-9163-4978-9017-5b7172ace6e5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:59.440590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:59.442285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.443742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.444161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.452202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 819/1639] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:59.455876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.457308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.458195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.488505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:59.491436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:59.503098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:39:59.505638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:39:59.516895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 821/1640] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:59.517761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:59.528625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 820/1641] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:39:59.548990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214f5cb-4c6e-4d14-a5b9-0fc9ceffff58 service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:59.557338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:59.558260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.558644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.559017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.584147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:59.586553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:59.594942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:39:59.607227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2dc5e-56b8-425c-977c-730e7a40abc4 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:39:59.617625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:39:59.618303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:39:59.618515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:39:59.618846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:39:59.631271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:39:59.631645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 822/1642] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:39:59.633036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59625412-df4f-4a3d-8b2d-13f357a68398 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:39:59.657650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 821/1643] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:39:59.901006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.057128 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17e510-1636-4747-b36b-97c368400251 service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.067657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.071008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.071293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.071667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] PATH_INFO: `/v3/users/90496a0cfd794101977371bc91435551` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.075528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90496a0cfd794101977371bc91435551)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:00.080545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: WARNING py.warnings [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:40:00.080545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: warnings.warn(msg) May 04 21:40:00.080545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: May 04 21:40:00.084227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:00.203738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cb2f-c265-4cd1-863a-2f698fdf2387 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.204313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cb2f-c265-4cd1-863a-2f698fdf2387 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.204313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8cb2f-c265-4cd1-863a-2f698fdf2387 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.206262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 822/1644] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 21:40:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:00.218182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.218659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.218843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.245120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90496a0cfd794101977371bc91435551'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.261586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:00.264536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90496a0cfd794101977371bc91435551'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.265916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.287763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 823/1645] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:00.291466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90496a0cfd794101977371bc91435551'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.292391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90496a0cfd794101977371bc91435551'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.297653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.307071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90496a0cfd794101977371bc91435551'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.312683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7373ab-9bb6-4ca6-a519-efd33b6298d2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.318224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.319111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.319574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.319855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] PATH_INFO: `/v3/users/52bb58aee3884ff4bf518a50f152c63a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.321094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bb58aee3884ff4bf518a50f152c63a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:00.323041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:00.324183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 823/1646] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:39:59 2022] DELETE /identity/v3/users/90496a0cfd794101977371bc91435551 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:00.327647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.330328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.414531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfd6bc-a857-44b7-bea9-d1fd5b72e2e9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.418845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.419578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.419937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.420136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.422188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bb58aee3884ff4bf518a50f152c63a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.422336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.471036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bb58aee3884ff4bf518a50f152c63a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.493828 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bb58aee3884ff4bf518a50f152c63a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.497032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bb58aee3884ff4bf518a50f152c63a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.520452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-489eddd0-dda2-4c04-9906-3428f95e0b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bb58aee3884ff4bf518a50f152c63a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:00.533097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 824/1647] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:00 2022] DELETE /identity/v3/users/52bb58aee3884ff4bf518a50f152c63a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:00.534894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.535166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.536290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.564524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:00.565923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.577877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:00.580798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187927d5-7534-47a4-b0e4-a2936a500b69 service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:00.597955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 824/1648] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:00.599936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.600404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.600989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.634485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:00.637407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.700244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 825/1649] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:00.725058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.727000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.766996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 825/1650] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:00.859304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f551c3-81ef-42ec-bb22-9c6948a9e5ae None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.864161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.864835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.865605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.865605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:00.892537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:00.896857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b8c58-6cc1-4dcf-b6e8-21bc655c3c88 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:00.933925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 826/1651] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:00.955855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:00.958442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:00.982580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80883660-a0bf-4ec6-9857-b2a958a7b8e2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:00.990057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:00.990730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:00.991011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:00.991290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.003733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:01.005234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ee320-bc73-4da3-b1cf-35146e9c66e4 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:01.020023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 826/1652] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:01.160989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55cab-7466-4a58-a8d0-684daf7f8086 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.162508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55cab-7466-4a58-a8d0-684daf7f8086 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.162698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55cab-7466-4a58-a8d0-684daf7f8086 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.164651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 827/1653] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 21:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:01.171095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.172202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.172590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.285286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:01.287861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:01.303437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 827/1654] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:40:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:01.345354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55cab-7466-4a58-a8d0-684daf7f8086 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:01.369333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55cab-7466-4a58-a8d0-684daf7f8086 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:01.379560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:01.380500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.381072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.381500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.395617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:01.397454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:01.423811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 828/1655] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:01.869634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:01.871194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:01.906306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f7f0c-b021-488c-b7f9-59d68581b8a8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:01.918483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:01.920134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:01.920563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:01.921116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] PATH_INFO: `/v3/projects/a65a81c528934038a20f3aa6c14df2d4` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:01.923268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65a81c528934038a20f3aa6c14df2d4)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:01.926913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:02.023131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65a81c528934038a20f3aa6c14df2d4', 'request_id': 'req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.030061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65a81c528934038a20f3aa6c14df2d4', 'request_id': 'req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.038535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65a81c528934038a20f3aa6c14df2d4', 'request_id': 'req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.055739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] The token cache is being invalidate because project a65a81c528934038a20f3aa6c14df2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:02.056281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.059165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-35359fd7-b821-4936-80e6-3b5dd0cf0b0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.061461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 828/1656] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:01 2022] DELETE /identity/v3/projects/a65a81c528934038a20f3aa6c14df2d4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:02.065897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:02.099075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c35340-53b5-4419-b14b-1ee3ec6aec92 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:02.175302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:02.176385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.176787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.177163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] PATH_INFO: `/v3/users/49335609c3684ef2a2c575422ac1d425` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.178669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49335609c3684ef2a2c575422ac1d425)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:02.180840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:02.271103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49335609c3684ef2a2c575422ac1d425'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.315902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49335609c3684ef2a2c575422ac1d425'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.335165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49335609c3684ef2a2c575422ac1d425'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.337222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49335609c3684ef2a2c575422ac1d425'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.359557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de7a4-1b04-41e6-b9da-bee040100303 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.360810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de7a4-1b04-41e6-b9da-bee040100303 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.360810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9de7a4-1b04-41e6-b9da-bee040100303 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.362625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49335609c3684ef2a2c575422ac1d425'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.365320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 829/1657] 10.222.0.23 () {54 vars in 960 bytes} [Wed May 4 21:40:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 04 21:40:02.373232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.374616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.374616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.375994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 829/1658] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:02 2022] DELETE /identity/v3/users/49335609c3684ef2a2c575422ac1d425 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:02.457783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:02.460379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:02.595043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3cc6d-68c0-47fd-ad42-a1de69b5bd30 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:02.639315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:02.640122 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:02.640673 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:02.640859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] PATH_INFO: `/v3/projects/9db0f3b8801b411eb52d06a256461ced` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:02.652051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db0f3b8801b411eb52d06a256461ced)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:02.660646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: WARNING py.warnings [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 04 21:40:02.660646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: warnings.warn(msg) May 04 21:40:02.660646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: May 04 21:40:02.668775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:02.678386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] MFA Rules not processed for user `a4018fbf31d0421d87101f4c771d8017`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:02.680440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:02.868256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 830/1659] 10.222.0.23 () {58 vars in 1057 bytes} [Wed May 4 21:40:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:02.885727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:02.891526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db0f3b8801b411eb52d06a256461ced', 'request_id': 'req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.899230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db0f3b8801b411eb52d06a256461ced', 'request_id': 'req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:02.924414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ba3a2-772a-468a-b76e-b26b9fc098d3 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:02.951556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db0f3b8801b411eb52d06a256461ced', 'request_id': 'req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.000940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] The token cache is being invalidate because project 9db0f3b8801b411eb52d06a256461ced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:03.003398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.006099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.014231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 830/1660] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:02 2022] DELETE /identity/v3/projects/9db0f3b8801b411eb52d06a256461ced => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:03.017529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:03.019436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:03.170557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:03.171364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:03.173023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:03.175692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:03.185083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:03.212815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c387d-4852-4c3e-8eb9-a7dd24f1ab71 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:03.218199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:03.220196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:03.236140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 831/1661] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:03.236426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:03.237343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:03.237628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:03.238067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] PATH_INFO: `/v3/users/ea9af23d37e141a89dca524b945b3a18` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:03.246712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9af23d37e141a89dca524b945b3a18)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:03.248728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:03.360813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9af23d37e141a89dca524b945b3a18'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.390794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9af23d37e141a89dca524b945b3a18'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.419043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9af23d37e141a89dca524b945b3a18'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.422241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9af23d37e141a89dca524b945b3a18'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.443358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b0440cf-c026-433f-a37e-94f2f9103155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9af23d37e141a89dca524b945b3a18'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:03.470560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 831/1662] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:03 2022] DELETE /identity/v3/users/ea9af23d37e141a89dca524b945b3a18 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:04.123560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:04.124993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:04.152533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f71126-e133-4777-82f3-439eaa8c5b5f service placement] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:04.302836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:04.303952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.304331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.304777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] PATH_INFO: `/v3/projects/c1d1d38807e0408e88610b194f319232` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.306338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d1d38807e0408e88610b194f319232)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:04.310542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:04.436312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d1d38807e0408e88610b194f319232', 'request_id': 'req-31821e1b-f7db-49cb-8eee-b44423a9a9f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:04.452566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d1d38807e0408e88610b194f319232', 'request_id': 'req-31821e1b-f7db-49cb-8eee-b44423a9a9f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:04.460699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d1d38807e0408e88610b194f319232', 'request_id': 'req-31821e1b-f7db-49cb-8eee-b44423a9a9f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:04.486152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] The token cache is being invalidate because project c1d1d38807e0408e88610b194f319232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:04.486690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:04.487565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-31821e1b-f7db-49cb-8eee-b44423a9a9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:04.499645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 832/1663] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:04 2022] DELETE /identity/v3/projects/c1d1d38807e0408e88610b194f319232 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:04.501445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.501909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.502913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.532422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:04.542437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:04.640871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 832/1664] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:04.650040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.651533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.652009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.678298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:04.680215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:04.691080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 833/1665] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:04.695905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:04.707535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65473be1-1027-4bfc-80b6-e3bf82f4e50e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:04.715040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:04.717510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.718107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.718517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.731534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:04.733314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:04.740536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:04.772081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:04.782087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa0095-06f4-498f-ab26-e1ff126dfde6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:04.784685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 833/1666] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:04.800654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:04.801342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.801617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.802047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.803096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:04.806485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:04.869467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 834/1667] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:04 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:04.873096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:04.886112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86cbbbc-da1e-404d-94b7-7247c39b5f38 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:04.985096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:04.986234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:04.986678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:04.987110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:04.988880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:04.991631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.036030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 834/1668] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:04 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:05.040590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.058570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a647f1-e0f5-4658-9078-6dcb9e63970d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.076383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.077318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.080253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.080725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.082196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.085763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.123358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 835/1669] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:05.127867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.142781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6285e9-46bd-4426-970c-f0201227a63b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.150696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.151763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.152271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.152656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.153630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.166619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe48474-5b9e-4b30-85bb-f1d71ec9adf3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.186866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 835/1670] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:05.190911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.206100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991f2dd-a20c-4660-9f5e-a071ed9b6119 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.224159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.225324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.226378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.226866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] PATH_INFO: `/v3/projects/a0cb64e01ea1486db3e5094213523205/users/fbed5f5a2c8d4a63903c1f543322b63d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.272501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0cb64e01ea1486db3e5094213523205, user_id=fbed5f5a2c8d4a63903c1f543322b63d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.275610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.315816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 836/1671] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:05 2022] PUT /identity/v3/projects/a0cb64e01ea1486db3e5094213523205/users/fbed5f5a2c8d4a63903c1f543322b63d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:05.327254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.327893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.328531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.390492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] MFA Rules not processed for user `fbed5f5a2c8d4a63903c1f543322b63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:05.391960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:05.508421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.510232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:05.529790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 836/1672] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:05.531201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.593795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ffab3-a6f2-4604-84c3-38862528a8a2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.599632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.600532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.600995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.601440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.602345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.604504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.650414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 837/1673] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:05 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:05.651416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.651873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b67fe-773d-4ab0-bb71-cea9c65b10c6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.749345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ec2ee-18df-4012-9536-ba37c83d7666 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.757914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.758909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.759197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.761016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.763926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.773059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.774078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:05.775093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.776611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.777023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] PATH_INFO: `/v3/projects/53904d4fb6714924b3d6623473f6701a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:05.779694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=53904d4fb6714924b3d6623473f6701a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:05.784207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:05.844341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 838/1674] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:05 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:05.845286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:05.877534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bb9bc-fff2-4760-82d6-5116d55b4829 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:05.883489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53904d4fb6714924b3d6623473f6701a', 'request_id': 'req-48facfac-abcf-411a-9b56-b11a1100a88d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:05.898020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53904d4fb6714924b3d6623473f6701a', 'request_id': 'req-48facfac-abcf-411a-9b56-b11a1100a88d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:05.926657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53904d4fb6714924b3d6623473f6701a', 'request_id': 'req-48facfac-abcf-411a-9b56-b11a1100a88d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:05.947265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] The token cache is being invalidate because project 53904d4fb6714924b3d6623473f6701a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:05.948265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:05.949274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-48facfac-abcf-411a-9b56-b11a1100a88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:05.954590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 837/1675] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:05 2022] DELETE /identity/v3/projects/53904d4fb6714924b3d6623473f6701a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:05.967591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1a898-c67a-4d3b-a053-db5de761c493 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:05.967977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1a898-c67a-4d3b-a053-db5de761c493 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:05.968321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1a898-c67a-4d3b-a053-db5de761c493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.010241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.011878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.012449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.012904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.013969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.015094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6ab1a898-c67a-4d3b-a053-db5de761c493 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:06.016072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.017242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6ab1a898-c67a-4d3b-a053-db5de761c493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.032327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 839/1676] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:06.033527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.035441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.046418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 838/1677] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:06.057789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4483cf2-b979-4f06-af6a-49a3487b3e30 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.058002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.058708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.059280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.063138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.064986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.065274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.065554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] PATH_INFO: `/v3/projects/c76a0e8687724b9db65e94f6a3906b1c/users/16a292c525c741f589c51d3aad6822ee/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.087100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76a0e8687724b9db65e94f6a3906b1c, user_id=16a292c525c741f589c51d3aad6822ee, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.091652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.099042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:06.100408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.117377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 840/1678] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:06 2022] PUT /identity/v3/projects/c76a0e8687724b9db65e94f6a3906b1c/users/16a292c525c741f589c51d3aad6822ee/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:06.121821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.231611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 839/1679] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:06.235958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.279797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128cb8-2f2d-4ef7-9109-b38f2436093f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.282444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624047f8-0f38-4a71-8526-78fa93370a16 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.291499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.293171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.294211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.294989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.295406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.297490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:06.297490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.297919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.298300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.298676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.300599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.303466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.311902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.318761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 840/1680] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:40:06.323729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.335088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 841/1681] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:06.340690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.343525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f913795a-f382-4210-9380-fbdcd6fee25a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.353947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c6949-8900-42e5-8226-04f81efd1ddb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.368246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.369041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.369698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.369971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.370678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.371613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.371889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.372783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] PATH_INFO: `/v3/projects/c76a0e8687724b9db65e94f6a3906b1c/users/16a292c525c741f589c51d3aad6822ee/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.372924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.375082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.380996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76a0e8687724b9db65e94f6a3906b1c, user_id=16a292c525c741f589c51d3aad6822ee, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.383718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ed4b-899b-40e2-a4b2-0b709b3d7a5c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.419867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 842/1682] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:06 2022] PUT /identity/v3/projects/c76a0e8687724b9db65e94f6a3906b1c/users/16a292c525c741f589c51d3aad6822ee/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:06.424004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.424295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.424560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.440144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 841/1683] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:06 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:06.441137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.481301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] MFA Rules not processed for user `16a292c525c741f589c51d3aad6822ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:06.483692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.538568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368548a4-18b9-4d2d-b835-a4c1e7492a55 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.554575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.555277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.555584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.555860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.556564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.559260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.595192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 842/1684] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:06 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:06.600537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.607990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 843/1685] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:06.619945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.623329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee79a7-9bde-4fa3-b9f1-1890f904734c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.624589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.641088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.642582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.644090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.644665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.646449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.653552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.693697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 843/1686] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:06.696794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.712114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d48f0-af0d-4fe5-9337-1c2fac58fd1d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.725343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.726141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.726530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.726913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.728894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.734391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.761021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 844/1687] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:06.765541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0ba3c-2082-4d7b-8133-1ccaf1a43b9f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.768695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:06.774416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.775343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.775966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.776374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.778618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:06.787571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619ec711-07ee-482b-9bfa-b2689263c8f9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:06.801277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:06.802374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.804670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.805830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] PATH_INFO: `/v3/projects/61df373ee1ca4ae0ba688b6c21b081fc/users/62159d6c8b5241a1acbd459f2001e531/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.852267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61df373ee1ca4ae0ba688b6c21b081fc, user_id=62159d6c8b5241a1acbd459f2001e531, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.854988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138016ca-cb5b-4091-9df7-961eb77d9313 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.880740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:06.883310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:06.893583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 845/1688] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:06 2022] PUT /identity/v3/projects/61df373ee1ca4ae0ba688b6c21b081fc/users/62159d6c8b5241a1acbd459f2001e531/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:06.896643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:06.897273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:06.897401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:06.915981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 844/1689] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:06.950959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] MFA Rules not processed for user `62159d6c8b5241a1acbd459f2001e531`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:06.952876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:07.086890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 846/1690] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:07.092745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.114483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5ccf7-f3f4-47e3-b416-a717eae081b3 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.286641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.286641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.286641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.286641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.287579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.298176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.365870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 845/1691] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:07 2022] POST /identity/v3/projects => generated 381 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:07.366796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.393617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d9b21-8736-4792-95c0-5b9a2398c85b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.524493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.525177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.525817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.525817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.526385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.528342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.583112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 847/1692] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:07 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:07.587777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.604270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8175c4-7ae9-493f-a3cf-b03b6b9bea4a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.613950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.616068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.618258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.619586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.621537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.623426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.710074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 846/1693] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:07.711809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.723639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cf220-11d9-482f-a03c-60764fba4ab4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.732596 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.733736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.734023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.734183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] PATH_INFO: `/v3/projects/139dd5b94a2d47849f61a6834fb733e9/users/9f5a3dddbccf45388529e0db61bfab65/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.760011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139dd5b94a2d47849f61a6834fb733e9, user_id=9f5a3dddbccf45388529e0db61bfab65, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.763521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.797244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 848/1694] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:07 2022] PUT /identity/v3/projects/139dd5b94a2d47849f61a6834fb733e9/users/9f5a3dddbccf45388529e0db61bfab65/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:07.801236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.812573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4d49d4-1ccf-424a-b7d9-1933cb47c3c4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.932811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.933884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.934387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.935599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:07.936622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:07.940312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278455b-4d84-4a88-be8e-008dd852addc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:07.968805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 847/1695] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:07.972581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:07.985271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9413c3b-0681-4a4c-8765-9641fc5abbf8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:07.993211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:07.994247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:07.994399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:07.994676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] PATH_INFO: `/v3/projects/139dd5b94a2d47849f61a6834fb733e9/users/9f5a3dddbccf45388529e0db61bfab65/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:08.000134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139dd5b94a2d47849f61a6834fb733e9, user_id=9f5a3dddbccf45388529e0db61bfab65, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:08.004626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:08.023868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 849/1696] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:07 2022] PUT /identity/v3/projects/139dd5b94a2d47849f61a6834fb733e9/users/9f5a3dddbccf45388529e0db61bfab65/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:08.035110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:08.035773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:08.036062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:08.070226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] MFA Rules not processed for user `9f5a3dddbccf45388529e0db61bfab65`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:08.071919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:08.173734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 848/1697] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:08.183098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:08.304000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aea8a-55c4-4d41-9c29-b1937ac7ce54 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:08.312698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:08.316614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:08.319937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:08.325040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:08.351066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:08.353704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75181835-1eb4-4486-b59f-afb26fa3f1db service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:08.388894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 850/1698] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:08.633794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:08.635218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:08.667078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57247a77-f0ca-4d22-9e3e-4ac653670fce None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:08.690092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:08.690851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:08.691134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:08.691483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:08.841882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:08.843416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:08.866237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 849/1699] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:10.072732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4913-3078-482d-a5c2-ed5687931e25 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:10.073608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4913-3078-482d-a5c2-ed5687931e25 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:10.074027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f4913-3078-482d-a5c2-ed5687931e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:10.103134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ef2f4913-3078-482d-a5c2-ed5687931e25 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:10.104674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ef2f4913-3078-482d-a5c2-ed5687931e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:10.250473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 851/1700] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:10.556364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:10.559242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:10.797079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e5078a-8044-45ef-bd71-300434dbe14b service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:10.816368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:10.817249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:10.817627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:10.818077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:10.840353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:10.842184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:10.870067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 850/1701] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:40:11.687822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506045d-d775-4e95-964f-3fcf57005492 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:11.688942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506045d-d775-4e95-964f-3fcf57005492 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:11.689496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506045d-d775-4e95-964f-3fcf57005492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:11.784808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7506045d-d775-4e95-964f-3fcf57005492 None None] MFA Rules not processed for user `7561c16d63774763b61bffd087aa6307`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:11.805446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7506045d-d775-4e95-964f-3fcf57005492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:12.130723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 852/1702] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:12.161632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:12.163167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:12.182892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:12.183658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:12.183988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:12.240563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:12.243063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:12.444306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 853/1703] 10.222.0.21 () {58 vars in 1015 bytes} [Wed May 4 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:12.453834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263ecbe-da25-4741-a9b6-4a9fb3733c50 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:12.477869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:12.477869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:12.477869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:12.477869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:12.503825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:12.512505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02803-2c8e-4a83-b877-b0ae5790f0ef service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:12.521685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:12.526001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:12.539509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 851/1704] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:12.569684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d35ca8-c86f-4906-b102-4ed714d7bf90 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:12.586971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:12.587697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:12.587987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:12.588254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:12.609501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:12.611416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450ceac-e585-4e2d-b7b9-e4de37690843 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:12.639555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5b6a-4480-4857-bdef-57cc2b4e5e9e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:12.643499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 854/1705] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:12.643914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5b6a-4480-4857-bdef-57cc2b4e5e9e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:12.644454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d5b6a-4480-4857-bdef-57cc2b4e5e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:12.749170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c66d5b6a-4480-4857-bdef-57cc2b4e5e9e None None] MFA Rules not processed for user `4b47d6eb074c484d8d8dd5552783d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:12.758639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c66d5b6a-4480-4857-bdef-57cc2b4e5e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:12.967207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 852/1706] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:13.123856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:13.125045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:13.125928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:13.213530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] MFA Rules not processed for user `c9109b244aef49a1a29050bb055c0ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:13.215611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:13.423768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 855/1707] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:13.430987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:13.431516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:13.431598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:13.482444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] MFA Rules not processed for user `c9109b244aef49a1a29050bb055c0ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:13.483733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:13.521672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 853/1708] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:13.959258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:13.977485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6567ba-9daa-43ca-8747-fc6ea7c59eb1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:13.983955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:13.985257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:13.985733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:13.986244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:13.996504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:13.998372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935652-692a-41a1-9734-5cb03323ec99 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:14.010106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 856/1709] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:14.063084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:14.064520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:14.109461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b718720-1933-4964-a301-0d19bd0a4612 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:14.126628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:14.126958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.127415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.127827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.144681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:14.146115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aee08-d320-495e-b0f6-f742f8dbe8b1 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:14.171278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 854/1710] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:14.590225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d308-2cfd-4f7e-b9b2-db7e7ff8e050 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.590805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d308-2cfd-4f7e-b9b2-db7e7ff8e050 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.590805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df4d308-2cfd-4f7e-b9b2-db7e7ff8e050 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.592337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 857/1711] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:14.680462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3a26-73f0-4f48-a203-5ef189170907 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:14.681463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3a26-73f0-4f48-a203-5ef189170907 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:14.682418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e3a26-73f0-4f48-a203-5ef189170907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:14.726046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6e0e3a26-73f0-4f48-a203-5ef189170907 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:14.728592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6e0e3a26-73f0-4f48-a203-5ef189170907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:14.783000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 855/1712] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:15.288465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:15.288751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:15.289027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:15.290709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 858/1713] 10.222.0.23 () {54 vars in 912 bytes} [Wed May 4 21:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:15.307644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:15.307929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:15.308379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:15.359450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:15.367248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:15.405076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:15.408363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:15.415770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 856/1714] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:15.430575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ba557-0fc0-4e90-8a87-92fe011fb5d2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:15.440065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:15.440831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:15.441115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:15.441390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:15.460243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:15.461632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa002e-df8c-4eb1-bc56-57a861eee025 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:15.476824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 859/1715] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:15.537386 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:15.559287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e6e19-8308-4101-83bd-2967b979ba88 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:15.574290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:15.575116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:15.575432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:15.575701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:15.604298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:15.608887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:15.647841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 857/1716] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:16.656559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc022-5d72-411c-86c2-932ddb287cef None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:16.657480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc022-5d72-411c-86c2-932ddb287cef None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:16.657972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279bc022-5d72-411c-86c2-932ddb287cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:16.722392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-279bc022-5d72-411c-86c2-932ddb287cef None None] MFA Rules not processed for user `c9109b244aef49a1a29050bb055c0ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:16.729209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-279bc022-5d72-411c-86c2-932ddb287cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:16.753595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 860/1717] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:17.867245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:17.882520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238174f6-bff8-42ce-9327-f217062e1c0b service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:17.910297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:17.913165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:17.914761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:17.916865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:18.172266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:18.177284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04a050-e549-47a3-966e-b89b1e64dd0c service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:18.229484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 858/1718] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:18.961360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:18.961878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:18.961952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:18.985685 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] MFA Rules not processed for user `7561c16d63774763b61bffd087aa6307`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:18.989050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:19.020336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 861/1719] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:19.853653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876795-7944-4d14-bc5b-8efcd650f6b1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:19.855104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876795-7944-4d14-bc5b-8efcd650f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:19.857149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876795-7944-4d14-bc5b-8efcd650f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:19.905103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-81876795-7944-4d14-bc5b-8efcd650f6b1 None None] MFA Rules not processed for user `4b47d6eb074c484d8d8dd5552783d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:19.906629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-81876795-7944-4d14-bc5b-8efcd650f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:19.931726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 859/1720] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:29.733684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:29.735216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:29.801168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c393331-0934-4e40-9baf-5975602fa1ef None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:29.806034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:29.806934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:29.807204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:29.807613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] PATH_INFO: `/v3/users/36ab1932fad74b32b5f46f7ee7717c4e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:29.808722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ab1932fad74b32b5f46f7ee7717c4e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:29.810633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:29.863821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ab1932fad74b32b5f46f7ee7717c4e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:29.870459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ab1932fad74b32b5f46f7ee7717c4e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:29.881533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ab1932fad74b32b5f46f7ee7717c4e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:29.882239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ab1932fad74b32b5f46f7ee7717c4e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:29.889650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ab1932fad74b32b5f46f7ee7717c4e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:29.897081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 862/1721] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:29 2022] DELETE /identity/v3/users/36ab1932fad74b32b5f46f7ee7717c4e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:29.901569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:29.902040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:29.902209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:29.919526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:29.920727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:29.981527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 860/1722] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:29.991445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:29.992922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:30.049388 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd9d23-f983-4679-b5f0-36aecc16ec2a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.053025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.053969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.054242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.054575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.065034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.066518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4bff8-8978-420a-a447-f803423e1e62 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.079192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 863/1723] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:30.382394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.385076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:30.407194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e5d8b7-4a31-4653-9fbf-8618388da7c8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.414285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.415928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.416806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.417571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] PATH_INFO: `/v3/projects/4762ea76ada249ff9dc089f9b323263a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.419305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4762ea76ada249ff9dc089f9b323263a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.422675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.485235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4762ea76ada249ff9dc089f9b323263a', 'request_id': 'req-879bda56-dead-4017-b652-217ef0468558'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:30.492530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4762ea76ada249ff9dc089f9b323263a', 'request_id': 'req-879bda56-dead-4017-b652-217ef0468558'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:30.499313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4762ea76ada249ff9dc089f9b323263a', 'request_id': 'req-879bda56-dead-4017-b652-217ef0468558'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:30.512457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] The token cache is being invalidate because project 4762ea76ada249ff9dc089f9b323263a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:30.512876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:30.513513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-879bda56-dead-4017-b652-217ef0468558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:30.515071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 861/1724] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:30 2022] DELETE /identity/v3/projects/4762ea76ada249ff9dc089f9b323263a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:30.519900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.520289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.520637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.541361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:30.542585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:30.615786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 864/1725] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:30.625759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.626182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.626510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.691044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:30.693035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:30.703620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 862/1726] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:30.708639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.718266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed573143-a1cb-481a-a278-be549fb44509 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.723220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.724019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.724389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.724726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.725534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:30.725906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.727618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.739500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 865/1727] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:30.744022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.753532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5563aa-11f0-4976-b830-c13f7ab2c87f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.757954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.758712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.758988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.759300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.760028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.761915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.786583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 863/1728] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:30 2022] POST /identity/v3/projects => generated 401 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:30.790745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.801003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0a154-bb86-47f7-8f63-bc8d62e6fd3c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.860077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.860767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.861043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.862066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.862774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.864723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.887791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 866/1729] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:30 2022] POST /identity/v3/users => generated 301 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:30.892173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.902617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40116526-610f-4f06-83a4-be3b895227ee admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.907281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.907973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.908257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.908560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.909295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.910903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.921155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 864/1730] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:30.925298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.934998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8be01b-1308-4f2f-973d-fcf9889fd270 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.940580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.941241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.941522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.941793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.942528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.944132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ce0a9-c552-43d3-b0ea-23718ee103b0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:30.954466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 867/1731] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:30.959130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:30.969084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed79b1-a05b-481b-ba52-b98e6bd065dd admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:30.973959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:30.974830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:30.975096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:30.975371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] PATH_INFO: `/v3/projects/dfe3bcbfc8014df7b7d965f1b13b6636/users/52541547eb6848498f880fa625c81db5/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:30.993497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe3bcbfc8014df7b7d965f1b13b6636, user_id=52541547eb6848498f880fa625c81db5, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:30.996250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.010783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 865/1732] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:30 2022] PUT /identity/v3/projects/dfe3bcbfc8014df7b7d965f1b13b6636/users/52541547eb6848498f880fa625c81db5/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:31.016014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.016339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.016617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.035777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:31.035777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.096182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 868/1733] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:31.105503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:31.107460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.144307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:31.146012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.158864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd628a-1b8b-489c-b2fa-81209eff8d5d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:31.163701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:31.164821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.165106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.165379 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] PATH_INFO: `/v3/users/62159d6c8b5241a1acbd459f2001e531` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.166553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd7f43-c473-48bd-9009-ba600124e834 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:31.166653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] RBAC: Authorizing `identity:delete_user(user_id=62159d6c8b5241a1acbd459f2001e531)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:31.168536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.170389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:31.170992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.171248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.171557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.183123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:31.184873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484580c-284d-4064-b3f4-ff797f0f8192 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.196025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 866/1734] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:31.226187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62159d6c8b5241a1acbd459f2001e531'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.237579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62159d6c8b5241a1acbd459f2001e531'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.251838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62159d6c8b5241a1acbd459f2001e531'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.252731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62159d6c8b5241a1acbd459f2001e531'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.264332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62159d6c8b5241a1acbd459f2001e531'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.272179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 869/1735] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:31 2022] DELETE /identity/v3/users/62159d6c8b5241a1acbd459f2001e531 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:31.277258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.277549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.277848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.299790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:31.301017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.370262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 867/1736] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:31.380531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:31.382009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.438907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1500e7-24f9-4f7b-8a88-6b96b6cfafda admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:31.442898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:31.443795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.444269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.444647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.454693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:31.456520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534c855-258e-4c71-8b31-8bce9e02a0da service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.466847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 870/1737] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:31.897030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:31.900055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:31.913574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126ef08-174b-4e6f-8a9e-9b0f70dac534 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:31.918940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:31.920114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.920393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.920661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] PATH_INFO: `/v3/projects/61df373ee1ca4ae0ba688b6c21b081fc` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:31.922067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=61df373ee1ca4ae0ba688b6c21b081fc)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:31.924078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:31.977065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61df373ee1ca4ae0ba688b6c21b081fc', 'request_id': 'req-4c36d47a-682e-4e04-963d-ebc921c27a1c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.983553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61df373ee1ca4ae0ba688b6c21b081fc', 'request_id': 'req-4c36d47a-682e-4e04-963d-ebc921c27a1c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.989970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61df373ee1ca4ae0ba688b6c21b081fc', 'request_id': 'req-4c36d47a-682e-4e04-963d-ebc921c27a1c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:31.996689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:31.997213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:31.997371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.004396 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] The token cache is being invalidate because project 61df373ee1ca4ae0ba688b6c21b081fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:32.004957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.005624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.007275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 868/1738] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:31 2022] DELETE /identity/v3/projects/61df373ee1ca4ae0ba688b6c21b081fc => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:32.011117 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.012517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.026766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] MFA Rules not processed for user `52541547eb6848498f880fa625c81db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:32.027927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.081877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36d47a-682e-4e04-963d-ebc921c27a1c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.088396 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.090067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.090890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.091241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] PATH_INFO: `/v3/users/9f5a3dddbccf45388529e0db61bfab65` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.092623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5a3dddbccf45388529e0db61bfab65)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.094572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.095067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 871/1739] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:32.099128 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.100678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.115002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fae25-d111-475d-9ae7-35bb7b2cef7e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.120579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.121258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.121726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.122165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.123044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.125377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.157224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5a3dddbccf45388529e0db61bfab65'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.158931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 872/1740] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:32.162572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.170262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5a3dddbccf45388529e0db61bfab65'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.177852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5a3dddbccf45388529e0db61bfab65'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.178768 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5a3dddbccf45388529e0db61bfab65'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.190469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5a3dddbccf45388529e0db61bfab65'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.197526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 869/1741] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:32 2022] DELETE /identity/v3/users/9f5a3dddbccf45388529e0db61bfab65 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:32.240911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7eab0e-525e-4495-98ef-6487aaa9676d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.325394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.326069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.326431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.326909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.328093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.331494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.357918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 873/1742] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:32.362135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.363840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.382301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ad100-1748-47ac-b350-be4a30008240 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.388933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.389801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.390086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.390362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.391109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.392810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.403369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 870/1743] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:32.410110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.420423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c13052-82a0-4344-92cc-82c73d93bbc2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.425516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.426507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.427030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.427149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] PATH_INFO: `/v3/projects/54b3b2be454e434f820a643e13febef3/users/5151baa6968049a1b2a625b8ac8a92a3/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.443198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b3b2be454e434f820a643e13febef3, user_id=5151baa6968049a1b2a625b8ac8a92a3, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.445965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.461236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 874/1744] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:32 2022] PUT /identity/v3/projects/54b3b2be454e434f820a643e13febef3/users/5151baa6968049a1b2a625b8ac8a92a3/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:32.465142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.476526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44156a-2d5a-4177-ba1c-5200bb421182 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.537381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.539068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.539237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.539819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.540074 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.540354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.541115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.542701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.557578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 871/1745] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:32.558143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84264cdb-ff20-44b3-a51c-81e98e7daf20 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.562109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.563976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.564859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.565143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.565419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] PATH_INFO: `/v3/projects/139dd5b94a2d47849f61a6834fb733e9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.566705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=139dd5b94a2d47849f61a6834fb733e9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.568707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.572102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69412081-f274-4e6b-909e-ac765428679c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.576823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.577743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.578024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.578297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] PATH_INFO: `/v3/projects/54b3b2be454e434f820a643e13febef3/users/5151baa6968049a1b2a625b8ac8a92a3/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.581923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b3b2be454e434f820a643e13febef3, user_id=5151baa6968049a1b2a625b8ac8a92a3, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.584598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f7df4-d892-4129-aa2f-5bb5696fcf72 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.596542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 872/1746] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:32 2022] PUT /identity/v3/projects/54b3b2be454e434f820a643e13febef3/users/5151baa6968049a1b2a625b8ac8a92a3/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:32.621179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139dd5b94a2d47849f61a6834fb733e9', 'request_id': 'req-8302d055-b389-4ada-922f-58c0e29d17d1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.628655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139dd5b94a2d47849f61a6834fb733e9', 'request_id': 'req-8302d055-b389-4ada-922f-58c0e29d17d1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.635597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139dd5b94a2d47849f61a6834fb733e9', 'request_id': 'req-8302d055-b389-4ada-922f-58c0e29d17d1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.651079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] The token cache is being invalidate because project 139dd5b94a2d47849f61a6834fb733e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:32.651367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.652080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8302d055-b389-4ada-922f-58c0e29d17d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:32.653932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 875/1747] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:32 2022] DELETE /identity/v3/projects/139dd5b94a2d47849f61a6834fb733e9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:32.658594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.658889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.659164 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.679525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:32.680918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.751152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 873/1748] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:32.759812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.760083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.760371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.797687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:32.798969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:32.808293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 876/1749] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:32.812982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.826519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fabfc-265f-4e67-92c3-faa712bd0379 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.831822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.832494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.832775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.833046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.833768 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:32.834067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.835663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.851423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 874/1750] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:32.855090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.864361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a9ff52-ceba-438d-861b-511d865d798a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.869412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:32.870254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:32.870528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:32.870805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:32.871550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:32.873501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:32.909886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 877/1751] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:32.911123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:32.925355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4545c-0056-4b83-a270-8d5b6e39bc27 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:32.998777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.000117 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.000529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.000871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.001642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.003821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.039643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 875/1752] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:32 2022] POST /identity/v3/users => generated 282 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:33.043836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.054621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b05ed0-8219-46fe-8a57-3d572cbe79fd admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.062971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.063704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.063988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.064267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.065096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.066692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.078712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 878/1753] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:33.084048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.094840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9026480-6da2-4ed9-93eb-054fd59ee59d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.099987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.100672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.100952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.101221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.101952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.103806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6bebb0-d05b-4b48-85fe-6bd2d155bf31 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.115687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 876/1754] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:33.119934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.131010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069b119-0927-47ab-aa50-22eaf9b05f3b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.136837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.137747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.138023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.138293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] PATH_INFO: `/v3/projects/78f6f904e8b148e5879aa3b598c624f3/users/44c36b885fd74e4fa05299d8bf5d710a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.154932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f6f904e8b148e5879aa3b598c624f3, user_id=44c36b885fd74e4fa05299d8bf5d710a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.157617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.173116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 879/1755] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:33 2022] PUT /identity/v3/projects/78f6f904e8b148e5879aa3b598c624f3/users/44c36b885fd74e4fa05299d8bf5d710a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:33.184739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.185025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.185298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.213440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] MFA Rules not processed for user `44c36b885fd74e4fa05299d8bf5d710a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:33.214802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:33.286837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 877/1756] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:33.291289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.353066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f8212-bc4e-4d38-acb7-6d704cc558e9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.359343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.360097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.360326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.360598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.361493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.363812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df7c88e-9971-41fe-819b-3a42a897a600 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.392926 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 880/1757] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:33 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:33.397037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.408249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835b23d-d320-4fe9-af02-a6d21eae90bd None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.453798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.454322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.454754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.476285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.477169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.477285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.477503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.478208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.480576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.483214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] MFA Rules not processed for user `5151baa6968049a1b2a625b8ac8a92a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:33.484648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:33.510842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 878/1758] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:33 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:33.514442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.524836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34284f-9151-4bdd-83e6-25d64a1e6cbe admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.531467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.532169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.532447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.532717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.533531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.535134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.545866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 879/1759] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:33.550674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.574019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988cc83-3fc7-4145-88a0-898084103590 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.579075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.580066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.580384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.580656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] PATH_INFO: `/v3/projects/d9dd31a8cdf141999dd95cc439e8b277/users/9375d8b419194a8189be14aee337b9c6/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.586572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 881/1760] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:33.596076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dd31a8cdf141999dd95cc439e8b277, user_id=9375d8b419194a8189be14aee337b9c6, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.598780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.614930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 880/1761] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:33 2022] PUT /identity/v3/projects/d9dd31a8cdf141999dd95cc439e8b277/users/9375d8b419194a8189be14aee337b9c6/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:33.619038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.630492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a502f6-ce6d-47c8-9036-1998d68c8c6f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.688632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.689396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.689736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.690014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.690748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.692559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f2f940-ada9-4056-94da-89792197ac23 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.706767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 882/1762] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:33.708465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.721354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509eeded-c39a-42fc-b65c-40ba0b6a5222 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.726860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.727796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.728072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.728394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] PATH_INFO: `/v3/projects/d9dd31a8cdf141999dd95cc439e8b277/users/9375d8b419194a8189be14aee337b9c6/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.730900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9dd31a8cdf141999dd95cc439e8b277, user_id=9375d8b419194a8189be14aee337b9c6, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.734021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.745794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 881/1763] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:33 2022] PUT /identity/v3/projects/d9dd31a8cdf141999dd95cc439e8b277/users/9375d8b419194a8189be14aee337b9c6/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:33.756530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.756825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.757164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.787838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] MFA Rules not processed for user `9375d8b419194a8189be14aee337b9c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:33.789040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:33.866082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 883/1764] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:33.877731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:33.879428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:33.934771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04596f5-4805-4466-baa0-4309d25bc5e2 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:33.938742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:33.939412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:33.939791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:33.940111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:33.949325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:33.950757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:33.960442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 882/1765] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:34.055333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:34.065591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf724594-8624-4612-a09a-84dc7a5b543e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:34.069527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:34.070176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:34.070453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:34.070725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:34.151959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:34.153537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:34.165961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 884/1766] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:34 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:34.986138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:34.987826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:35.061513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c301-cdfd-4727-849c-7468be832206 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:35.067419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:35.068296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:35.068578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:35.068853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] PATH_INFO: `/v3/users/52541547eb6848498f880fa625c81db5` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:35.070081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52541547eb6848498f880fa625c81db5)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:35.072064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:35.119068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52541547eb6848498f880fa625c81db5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.131307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52541547eb6848498f880fa625c81db5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.138824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52541547eb6848498f880fa625c81db5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.139669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52541547eb6848498f880fa625c81db5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.149418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52541547eb6848498f880fa625c81db5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.156755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 883/1767] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:34 2022] DELETE /identity/v3/users/52541547eb6848498f880fa625c81db5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:35.364344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:35.378369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b7f20-04f1-4392-8199-61cf0d4a221c service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:35.444873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:35.445806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:35.446153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:35.446489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] PATH_INFO: `/v3/projects/dfe3bcbfc8014df7b7d965f1b13b6636` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:35.447776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe3bcbfc8014df7b7d965f1b13b6636)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:35.449674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:35.498240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe3bcbfc8014df7b7d965f1b13b6636', 'request_id': 'req-7eedcfd7-1d77-48d9-890b-de125ab145fb'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.503967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe3bcbfc8014df7b7d965f1b13b6636', 'request_id': 'req-7eedcfd7-1d77-48d9-890b-de125ab145fb'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.518335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe3bcbfc8014df7b7d965f1b13b6636', 'request_id': 'req-7eedcfd7-1d77-48d9-890b-de125ab145fb'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.531450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] The token cache is being invalidate because project dfe3bcbfc8014df7b7d965f1b13b6636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:35.531736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.532374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.533949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 885/1768] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:35 2022] DELETE /identity/v3/projects/dfe3bcbfc8014df7b7d965f1b13b6636 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:35.538247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:35.539848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:35.554265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49be6-3ba7-469b-b7a2-41779d9f15e6 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:35.611819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:35.612707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:35.612990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:35.613274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] PATH_INFO: `/v3/users/5151baa6968049a1b2a625b8ac8a92a3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:35.614438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5151baa6968049a1b2a625b8ac8a92a3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:35.616518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:35.675635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5151baa6968049a1b2a625b8ac8a92a3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.688656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5151baa6968049a1b2a625b8ac8a92a3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.696369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5151baa6968049a1b2a625b8ac8a92a3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.697105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5151baa6968049a1b2a625b8ac8a92a3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.707142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7d2e7731-47fd-4327-9bb5-6d073fbcb573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5151baa6968049a1b2a625b8ac8a92a3'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:35.716292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 884/1769] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:35 2022] DELETE /identity/v3/users/5151baa6968049a1b2a625b8ac8a92a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:35.940505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:35.941972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:35.955716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedcfd7-1d77-48d9-890b-de125ab145fb admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.033430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.033430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.033430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.033430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] PATH_INFO: `/v3/projects/54b3b2be454e434f820a643e13febef3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.033779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b3b2be454e434f820a643e13febef3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.034917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.083028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b3b2be454e434f820a643e13febef3', 'request_id': 'req-413bc479-2d1b-471e-b385-0f79f928737a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:36.088922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b3b2be454e434f820a643e13febef3', 'request_id': 'req-413bc479-2d1b-471e-b385-0f79f928737a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:36.095199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b3b2be454e434f820a643e13febef3', 'request_id': 'req-413bc479-2d1b-471e-b385-0f79f928737a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:36.107293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] The token cache is being invalidate because project 54b3b2be454e434f820a643e13febef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:36.107623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:36.108272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-413bc479-2d1b-471e-b385-0f79f928737a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:36.109855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 886/1770] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:35 2022] DELETE /identity/v3/projects/54b3b2be454e434f820a643e13febef3 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:36.114900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.115366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.115514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.134258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:36.135406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:36.197330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 885/1771] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:36.206614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.206896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.207165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.225860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:36.227040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:36.235271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 887/1772] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:36.239824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.249450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fdbba-345f-4e7c-b626-ec006b9fe761 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.254109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.254763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.255046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.255311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.256072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:36.256374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.257965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.269621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 886/1773] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:36.274309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.283847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcffd5-184c-4fb6-b3ca-b56bec22caa4 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.289779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.290522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.290800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.291065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.291787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.293661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.323326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 888/1774] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:36.324777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.335146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495148cf-a5a0-4a78-b04c-91175f54a618 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.388746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.389369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.389650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.389920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.390633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.392647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.412879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 887/1775] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:36.417358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.427747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67aff2-b837-4876-8a56-3853d83b9191 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.433148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.433802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.434083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.434381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.435124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.436739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.447212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 889/1776] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:36.452647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.462971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68bd209-5df4-4548-afa7-88111fd10e47 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.468294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.468942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.469222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.469492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.470241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.471873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110522ea-31ff-4bba-a851-78c955918c3a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.482067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 888/1777] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:36.486372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.496566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481ec-40f9-4cb0-870f-fbfd023f7204 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.502415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.503290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.503600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.503871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] PATH_INFO: `/v3/projects/0c2bc1381d34468da0bbd525e7fe95c5/users/3ca7591a99e64c91b26f28bafa99d1a1/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.519929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2bc1381d34468da0bbd525e7fe95c5, user_id=3ca7591a99e64c91b26f28bafa99d1a1, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.522542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.537609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 890/1778] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:36 2022] PUT /identity/v3/projects/0c2bc1381d34468da0bbd525e7fe95c5/users/3ca7591a99e64c91b26f28bafa99d1a1/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:36.548118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.548403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.548669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.575366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] MFA Rules not processed for user `3ca7591a99e64c91b26f28bafa99d1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:36.577786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:36.641548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 889/1779] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:36.646319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.716016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a7216-c3ff-45b6-a829-58cf6029eb51 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.722395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.723081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.723405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.724143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.725405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.727583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.764312 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 891/1780] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:36.765462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.783962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e931d-880d-4790-8469-73cc2dd948a6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.866947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.867749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.868028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.868392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.869287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.871639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.902352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 890/1781] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:36 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:36.906097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.918386 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cb0a8-3b87-4375-a74f-5d35f59e3db8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.940464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.941160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.941421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.941765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:36.942615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:36.944372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:36.959417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 892/1782] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:36.961571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:36.978634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415263-0168-4421-a5ed-b620d5965536 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:36.986072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:36.987479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:36.987771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:36.988235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] PATH_INFO: `/v3/projects/135a6ae6048049bd87d6d745826fe8fa/users/435a36ce22a54100b29861b461e83fdd/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.005633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135a6ae6048049bd87d6d745826fe8fa, user_id=435a36ce22a54100b29861b461e83fdd, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:37.008753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:37.028234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 891/1783] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:36 2022] PUT /identity/v3/projects/135a6ae6048049bd87d6d745826fe8fa/users/435a36ce22a54100b29861b461e83fdd/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:37.034461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:37.049003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42a368-d4d5-4d0b-ab33-ad1f6f8a60cf admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:37.193698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:37.194399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.194679 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.194945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.199285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:37.201349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640c3190-9bce-4346-b6ad-6030d96d0608 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:37.225547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 893/1784] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:37.233775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:37.260397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0603fc96-adfa-4727-b2dc-f755cbb41708 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:37.268510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:37.269615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.269969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.270309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] PATH_INFO: `/v3/projects/135a6ae6048049bd87d6d745826fe8fa/users/435a36ce22a54100b29861b461e83fdd/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.286571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135a6ae6048049bd87d6d745826fe8fa, user_id=435a36ce22a54100b29861b461e83fdd, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:37.292938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:37.324832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 892/1785] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:37 2022] PUT /identity/v3/projects/135a6ae6048049bd87d6d745826fe8fa/users/435a36ce22a54100b29861b461e83fdd/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:37.337801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.338952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.339238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.401027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] MFA Rules not processed for user `435a36ce22a54100b29861b461e83fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:37.402232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:37.603292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 894/1786] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:37.607784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:37.610203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:37.639079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:37.640739 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:37.706658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869536c-d628-4069-9db5-4b6b154e1262 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:37.712233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:37.713304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.713750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.714112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] PATH_INFO: `/v3/users/2228b96f4ac94d41acc3329baf22fc3c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.715642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2228b96f4ac94d41acc3329baf22fc3c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:37.717777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:37.777376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec463dc-ed46-4935-8485-604b901088b9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:37.781432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:37.782293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.782787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.783302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.795817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:37.804869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8f14f-c36c-4f94-ba56-6efe2f82287b service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:37.806562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2228b96f4ac94d41acc3329baf22fc3c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:37.831065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2228b96f4ac94d41acc3329baf22fc3c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:37.832113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 895/1787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:37 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:37.839689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2228b96f4ac94d41acc3329baf22fc3c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:37.840648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2228b96f4ac94d41acc3329baf22fc3c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:37.854717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2228b96f4ac94d41acc3329baf22fc3c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:37.868496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 893/1788] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:37 2022] DELETE /identity/v3/users/2228b96f4ac94d41acc3329baf22fc3c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:37.873301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.873778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.874216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:37.881433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:37.890179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:37.894910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:37.896124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:37.989901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c522de8-23f0-4a6e-bf47-66d2a375a0f4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:37.996387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:37.997577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:37.997854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:37.998308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] PATH_INFO: `/v3/users/3ca7591a99e64c91b26f28bafa99d1a1` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.000313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca7591a99e64c91b26f28bafa99d1a1)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:38.003422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:38.017355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 896/1789] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:38.033282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:38.034960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.075909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca7591a99e64c91b26f28bafa99d1a1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.091410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca7591a99e64c91b26f28bafa99d1a1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.101837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca7591a99e64c91b26f28bafa99d1a1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.103343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca7591a99e64c91b26f28bafa99d1a1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.114670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceecb5e-8636-4575-8868-cd5035454b8f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:38.114978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7b08a4eb-dfc7-4bb9-bc7a-e98e89d3489a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca7591a99e64c91b26f28bafa99d1a1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.118557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:38.119342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.119750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.120176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.122640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.128082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 894/1790] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:37 2022] DELETE /identity/v3/users/3ca7591a99e64c91b26f28bafa99d1a1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:38.132523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.132878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.133223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.135704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:38.137374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:38.154249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 897/1791] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:38.157833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:38.160089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.232602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 895/1792] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:38.249225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:38.256703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.275407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135384e-1aa9-4ad2-acb5-6f5d0b942069 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:38.330322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:38.331293 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.331633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.332042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.344299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:38.345784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:38.355557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 898/1793] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:38.841082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:38.842853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.855137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de137c7-3142-4e8e-a691-1501797c2480 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:38.860627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:38.861529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.861813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.862085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] PATH_INFO: `/v3/projects/004cd813ea584b699231235e3d46c717` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.863295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=004cd813ea584b699231235e3d46c717)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:38.865483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:38.899818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:38.902514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.916173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '004cd813ea584b699231235e3d46c717', 'request_id': 'req-59a8064f-bda0-4464-8e03-331aa931c2b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.916856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8e65b-bd2a-46ba-9e58-be5331c85902 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:38.928761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '004cd813ea584b699231235e3d46c717', 'request_id': 'req-59a8064f-bda0-4464-8e03-331aa931c2b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.935564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '004cd813ea584b699231235e3d46c717', 'request_id': 'req-59a8064f-bda0-4464-8e03-331aa931c2b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.950280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] The token cache is being invalidate because project 004cd813ea584b699231235e3d46c717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:38.950564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.951260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-59a8064f-bda0-4464-8e03-331aa931c2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:38.952773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 896/1794] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:38 2022] DELETE /identity/v3/projects/004cd813ea584b699231235e3d46c717 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:38.958368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347af8-6501-406b-a945-5cb6cc8544b3 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.958651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347af8-6501-406b-a945-5cb6cc8544b3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.958921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5347af8-6501-406b-a945-5cb6cc8544b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.973282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:38.974118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.974395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.974674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] PATH_INFO: `/v3/projects/0c2bc1381d34468da0bbd525e7fe95c5` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:38.975878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2bc1381d34468da0bbd525e7fe95c5)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:38.976917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b5347af8-6501-406b-a945-5cb6cc8544b3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:38.977768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:38.978123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b5347af8-6501-406b-a945-5cb6cc8544b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:38.993288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 897/1795] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:38.994705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:38.994990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:38.995268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.013710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:39.014897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.023568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2bc1381d34468da0bbd525e7fe95c5', 'request_id': 'req-8cb89dd6-4feb-488e-ae6f-f539a294061d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.031323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2bc1381d34468da0bbd525e7fe95c5', 'request_id': 'req-8cb89dd6-4feb-488e-ae6f-f539a294061d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.037730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2bc1381d34468da0bbd525e7fe95c5', 'request_id': 'req-8cb89dd6-4feb-488e-ae6f-f539a294061d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.054295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] The token cache is being invalidate because project 0c2bc1381d34468da0bbd525e7fe95c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:39.054720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.055367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.056953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 899/1796] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:38 2022] DELETE /identity/v3/projects/0c2bc1381d34468da0bbd525e7fe95c5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:39.060866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.064539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.084391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 898/1797] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:39.088225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.100394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535d6e-5469-4b20-95c0-89d8315d9f05 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.105085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.105897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.106181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.106452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.107187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:39.107525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.109120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.123434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 899/1798] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:40:39.125630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.135996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cd45c-617f-4039-856f-2042fc766d40 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.140554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.141221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.141505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.141808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.142529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.144468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.154765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb89dd6-4feb-488e-ae6f-f539a294061d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.162252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.163240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.163588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.163863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] PATH_INFO: `/v3/users/435a36ce22a54100b29861b461e83fdd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.165956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=435a36ce22a54100b29861b461e83fdd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.168065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.180458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 900/1799] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:39.181905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.238538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435a36ce22a54100b29861b461e83fdd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.241318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435a36ce22a54100b29861b461e83fdd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.254943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435a36ce22a54100b29861b461e83fdd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.256106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435a36ce22a54100b29861b461e83fdd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.261829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6b6a8-390e-42e8-bb49-bfd911396103 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.269389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435a36ce22a54100b29861b461e83fdd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.271455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.272312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.272689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.273101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.273926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.275982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 900/1800] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:39 2022] DELETE /identity/v3/users/435a36ce22a54100b29861b461e83fdd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:39.276103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.302540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 901/1801] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:39.306957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.308459 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.376960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41c002-5e6f-4801-a95b-c98e579946bf admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.382283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.383048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.383283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.383771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.384524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.386117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.396448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 901/1802] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:39.400747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.411293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370413a-9094-4917-a600-12b5972b55e4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.416616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.417466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.417890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.418322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.419316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.421861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2aeef2-b249-4d42-a61e-276a7dbfb0fa admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.432781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 902/1803] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:39.437043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.448541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf544c-1938-40e5-b4fc-57884151b4cc admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.453696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.454591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.454871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.455177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] PATH_INFO: `/v3/projects/ef2cb9bf32c14df980aeeaeaa989231d/users/b7683ebe9f2944f3bff4363b90568132/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.472381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef2cb9bf32c14df980aeeaeaa989231d, user_id=b7683ebe9f2944f3bff4363b90568132, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.475104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.488824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 902/1804] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:39 2022] PUT /identity/v3/projects/ef2cb9bf32c14df980aeeaeaa989231d/users/b7683ebe9f2944f3bff4363b90568132/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:39.499297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.499640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.499917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.527525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] MFA Rules not processed for user `b7683ebe9f2944f3bff4363b90568132`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:39.528745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.560765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.563208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.601010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 903/1805] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:39.612137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.613639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.633365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742a2f2-6a07-47ad-8501-b045d9f29c1f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.638004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.638928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.639209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.639518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] PATH_INFO: `/v3/projects/135a6ae6048049bd87d6d745826fe8fa` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.640727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=135a6ae6048049bd87d6d745826fe8fa)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.642798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.686271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104c5b8-39bf-46cf-8984-3fda1821b5ca None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.686587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135a6ae6048049bd87d6d745826fe8fa', 'request_id': 'req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.691800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135a6ae6048049bd87d6d745826fe8fa', 'request_id': 'req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.697654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135a6ae6048049bd87d6d745826fe8fa', 'request_id': 'req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.711073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] The token cache is being invalidate because project 135a6ae6048049bd87d6d745826fe8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:39.711357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.712208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5d3b1f0b-81d4-469d-a4ca-d1fe7455b3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:39.714100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 903/1806] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:39 2022] DELETE /identity/v3/projects/135a6ae6048049bd87d6d745826fe8fa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:39.718779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81563ba-48c7-42eb-badf-d4d808646760 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.719073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81563ba-48c7-42eb-badf-d4d808646760 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.719347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81563ba-48c7-42eb-badf-d4d808646760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.737099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d81563ba-48c7-42eb-badf-d4d808646760 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:39.738341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d81563ba-48c7-42eb-badf-d4d808646760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.748195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.748778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.749052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.749319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.751130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.797825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 904/1807] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:39.806033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.806634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.806938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.807212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.807724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.816822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 904/1808] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:39.825756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:39.826815 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:39.837149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 905/1809] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:39.841388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.853385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80d0ff-3505-4241-9495-e1efa4a24cb3 service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.859285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.859993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.860273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.860546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.861348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:39.861653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.863249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.876699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 905/1810] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:39.881990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.890894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a653eb8-cf10-42a4-b8a2-c1db6320fcbe None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:39.895498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:39.896152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:39.896434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:39.896706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:39.897395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:39.899292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:39.927175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 906/1811] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:39.931312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:39.944465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da360d80-6760-45fc-8d87-78dd53e30f09 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.000329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.000948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.001227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.001556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.002211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.004181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.016141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.018115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.027798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 906/1812] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:39 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:40.028838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.030413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227ca74-7d5d-44b6-832e-231a8e9aa228 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.035194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.036095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.036366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.036635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] PATH_INFO: `/v3/users/b7683ebe9f2944f3bff4363b90568132` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.037814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7683ebe9f2944f3bff4363b90568132)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.038597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f1dc8-83d7-4a8c-83e2-74976aee1578 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.039759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.043946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.044595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.044875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.045144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.045870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.047462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.057685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 907/1813] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:40.061499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.071721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688f181-31b7-4e8c-882a-8bfb02a94656 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.076512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.077175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.077457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.077732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.078450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.080098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.086577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7683ebe9f2944f3bff4363b90568132'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.093558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 908/1814] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:40.093710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7683ebe9f2944f3bff4363b90568132'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.094834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.105105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a0f1-105e-40a7-9cb3-99de3f39f924 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.105608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7683ebe9f2944f3bff4363b90568132'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.106307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7683ebe9f2944f3bff4363b90568132'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.109945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.110885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.111247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.111561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] PATH_INFO: `/v3/projects/73143010de794ba297ce24102ee508c4/users/98e8c287fb0345b2a96c54756629ec5c/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.115253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-16c88423-ca23-4139-a9be-93c57e1698de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7683ebe9f2944f3bff4363b90568132'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.122025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 907/1815] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:40 2022] DELETE /identity/v3/users/b7683ebe9f2944f3bff4363b90568132 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:40.126251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.126539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.126957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.133394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73143010de794ba297ce24102ee508c4, user_id=98e8c287fb0345b2a96c54756629ec5c, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.136299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfe6e4-52d0-4c06-8671-121e93214a74 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.144397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:40.145808 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.161411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 909/1816] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:40 2022] PUT /identity/v3/projects/73143010de794ba297ce24102ee508c4/users/98e8c287fb0345b2a96c54756629ec5c/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:40.163661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.163951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.164394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.190370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] MFA Rules not processed for user `98e8c287fb0345b2a96c54756629ec5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:40.191606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.207583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 908/1817] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:40.217652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.219063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.259676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 910/1818] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:40.264202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.265643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.280873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a0a21-f666-4deb-b616-4d6a278a7ebb None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.284450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f33cb-421d-4680-bf28-9ec230d3ffed None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.285495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.286169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.286452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.286725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.287443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.289221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.289869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.289983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.290144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.290415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.303415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.305765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.318091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 909/1819] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:40.320691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 911/1820] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:40.324533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.334494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c9c616-5040-4499-8785-f10fa1ff6df4 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.391342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.392057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.392399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.393006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.393529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.395566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.415454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 910/1821] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:40.419756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.431077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ea15-59b8-4e95-ad6f-20c57abe133c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.435926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.436814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.437102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.437373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.438105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.440076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.452014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 912/1822] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:40.457307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.467800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623b836-203f-4b9b-bcd6-6b1de34d163f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.473488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.474381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.474660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.475521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] PATH_INFO: `/v3/projects/6cffaad26f194b6cafbb475464062ebb/users/ea5159c98f574f7f89bc9c8771e91c5d/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.493786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cffaad26f194b6cafbb475464062ebb, user_id=ea5159c98f574f7f89bc9c8771e91c5d, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.496283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.510708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 911/1823] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:40 2022] PUT /identity/v3/projects/6cffaad26f194b6cafbb475464062ebb/users/ea5159c98f574f7f89bc9c8771e91c5d/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:40.514585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.524932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae64f5-652f-4893-8b7e-3c0377ad7dcf admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.586638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.587327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.587630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.587903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.588633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.590211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3344ab-5d52-44dc-9ead-da0b959b246b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.600920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 913/1824] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:40.605077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.616133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f2f57-6a41-465c-95e3-ac06a5dc3f9a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.620948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.621843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.622123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.622465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] PATH_INFO: `/v3/projects/6cffaad26f194b6cafbb475464062ebb/users/ea5159c98f574f7f89bc9c8771e91c5d/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.624591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cffaad26f194b6cafbb475464062ebb, user_id=ea5159c98f574f7f89bc9c8771e91c5d, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.627277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.639023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 912/1825] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:40 2022] PUT /identity/v3/projects/6cffaad26f194b6cafbb475464062ebb/users/ea5159c98f574f7f89bc9c8771e91c5d/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:40.650583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.650877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.651152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.676344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] MFA Rules not processed for user `ea5159c98f574f7f89bc9c8771e91c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:40.677537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.698953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.700650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.747004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 914/1826] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:40.758088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.759581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.765960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aac66-eea4-4a19-a178-f92d8b73b68b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.770496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.771362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.771660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.771935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] PATH_INFO: `/v3/projects/ef2cb9bf32c14df980aeeaeaa989231d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.773133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef2cb9bf32c14df980aeeaeaa989231d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.775014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.817696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261726-af3f-4eac-9f62-545d003072fc None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.819890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef2cb9bf32c14df980aeeaeaa989231d', 'request_id': 'req-a238a7ea-2412-452d-ad63-dd5d36663ff3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.825069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef2cb9bf32c14df980aeeaeaa989231d', 'request_id': 'req-a238a7ea-2412-452d-ad63-dd5d36663ff3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.831588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef2cb9bf32c14df980aeeaeaa989231d', 'request_id': 'req-a238a7ea-2412-452d-ad63-dd5d36663ff3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.844697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] The token cache is being invalidate because project ef2cb9bf32c14df980aeeaeaa989231d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:40.844984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.845657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a238a7ea-2412-452d-ad63-dd5d36663ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:40.847240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 913/1827] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:40 2022] DELETE /identity/v3/projects/ef2cb9bf32c14df980aeeaeaa989231d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:40.851950 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761caeb-d6ec-4e40-b9ce-17083db4ac3f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.852234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761caeb-d6ec-4e40-b9ce-17083db4ac3f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.852508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761caeb-d6ec-4e40-b9ce-17083db4ac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.865916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.866627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.866935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.867323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.869360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.869717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4761caeb-d6ec-4e40-b9ce-17083db4ac3f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:40.870871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4761caeb-d6ec-4e40-b9ce-17083db4ac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.927058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 914/1828] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:40.928330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.929780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:40.936331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.936787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.936860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.938874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 915/1829] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:40.963495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:40.964696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:40.973926 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 915/1830] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:40.978498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:40.989840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87626c8b-c2bc-4c83-9c30-dfde64e49ee9 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:40.995344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:40.996041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:40.996321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:40.996595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:40.997330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:40.997622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:40.999217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.012801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 916/1831] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:41.017218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.026185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92440fc-4ebf-4a59-99f2-43d6bef2107b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.030759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.031435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.031712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.031977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.032654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.034604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.060306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 916/1832] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:41.064524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.075557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23cd91-8a9b-46c0-9a39-9a5525ee5c54 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.132805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.133482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.133763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.134035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.134737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.137043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.160272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 917/1833] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:41.161917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.172908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4924ba-7916-4ce2-862a-dd54886feecd admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.178625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.179279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.179592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.179857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.180582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.182159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.195604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 917/1834] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:41.197246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.211862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e7bf7-d1c6-42ac-b98e-d757c867e989 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.218998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.219824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.220166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.220661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.221487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.223706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab79944-8833-4da4-9bd6-82b6b1b4aada admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.252767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 918/1835] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:41.254302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.265802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b83a26-70de-4932-a2ba-ab38ec9a29a7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.271190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.272196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.272558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.272898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] PATH_INFO: `/v3/projects/b63756d17a704d55bca2722ee1db4654/users/64abf2ffaffe4eefbce850620ca6fb77/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.287967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63756d17a704d55bca2722ee1db4654, user_id=64abf2ffaffe4eefbce850620ca6fb77, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.290965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.304418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 918/1836] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:41 2022] PUT /identity/v3/projects/b63756d17a704d55bca2722ee1db4654/users/64abf2ffaffe4eefbce850620ca6fb77/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:41.317395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.317724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.318022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.346884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] MFA Rules not processed for user `64abf2ffaffe4eefbce850620ca6fb77`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:41.348363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:41.411731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 919/1837] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:41.416309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.477869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f45e5d-d392-452c-859b-e574f96ae665 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.482578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.483232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.483537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.483804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.484484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.486471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.514323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 919/1838] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/projects => generated 393 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:41.515626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.526747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad8b5b-9c2a-43dc-8208-f4c238b65d8c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.583778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.584459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.584735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.585128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.585832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.587753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.611427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 920/1839] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:41.613429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.625306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6bf84-cd05-4f05-8f9f-101643d8d9a5 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.630009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.630672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.630954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.631225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.632025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.633601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.644661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 920/1840] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:41.648739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.659165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79160f-74de-40e4-972b-f9a56a06d125 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.664160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.665440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.665721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.665985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] PATH_INFO: `/v3/projects/0e94f3a7b6ca48358cb19127c68d3367/users/88d97b736ebb410ba10d24d25502172b/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.680796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e94f3a7b6ca48358cb19127c68d3367, user_id=88d97b736ebb410ba10d24d25502172b, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.683483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.697002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 921/1841] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:41 2022] PUT /identity/v3/projects/0e94f3a7b6ca48358cb19127c68d3367/users/88d97b736ebb410ba10d24d25502172b/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:41.700752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.710724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774292bb-3bb5-4a98-8f46-45037055cf56 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.765122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.765787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.766065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.766971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.767755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.769343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5c7e-2526-40e3-b3c4-34812adde31a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.779363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 921/1842] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:41.783325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.793941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b8422-20d3-4863-94fb-9b9a63af000f admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:41.799041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:41.799967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.800251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.800527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] PATH_INFO: `/v3/projects/0e94f3a7b6ca48358cb19127c68d3367/users/88d97b736ebb410ba10d24d25502172b/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.802610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e94f3a7b6ca48358cb19127c68d3367, user_id=88d97b736ebb410ba10d24d25502172b, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:41.805298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:41.815957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 922/1843] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:41 2022] PUT /identity/v3/projects/0e94f3a7b6ca48358cb19127c68d3367/users/88d97b736ebb410ba10d24d25502172b/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:41.826036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:41.826320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:41.826592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:41.853952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] MFA Rules not processed for user `88d97b736ebb410ba10d24d25502172b`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:41.855135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:41.925711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 922/1844] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:41.937087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:41.938894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:41.997030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e342d5-13b2-4171-b002-1ce80aaf957d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:42.001274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:42.001945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:42.002226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:42.002501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:42.011732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:42.013167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f92761-74a3-40f4-8558-73108217b924 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:42.022563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 923/1845] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:42.083461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:42.085069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:42.104416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05b266-59dd-435d-9310-be1c70995133 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:42.115374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:42.116272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:42.116582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:42.116844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:42.199491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:42.201031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa8c63-3ec3-4933-ac40-6db18b97506d service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:42.223859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 923/1846] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:43.648226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:43.649045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:43.649465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:43.651274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 924/1847] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:43.927087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4afa-24d3-40ff-bd7d-6e5899178f31 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:43.928022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4afa-24d3-40ff-bd7d-6e5899178f31 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:43.928570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b4afa-24d3-40ff-bd7d-6e5899178f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:43.964573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7f6b4afa-24d3-40ff-bd7d-6e5899178f31 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:43.965742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7f6b4afa-24d3-40ff-bd7d-6e5899178f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:44.061511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 924/1848] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:40:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:44.081133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:44.083078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:44.103072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1284d9a-cdc6-4ff8-9cc0-6ff9b9383a47 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:44.110624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:44.111315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:44.111628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:44.111908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:44.121152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:44.122736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2474b9-1d49-46bc-b668-a467bf2ab010 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:44.133557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 925/1849] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:45.778468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63d06-4c15-44cd-87f0-adfba26cabb5 None None] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:45.779400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63d06-4c15-44cd-87f0-adfba26cabb5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:45.780626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f63d06-4c15-44cd-87f0-adfba26cabb5 None None] PATH_INFO: `/` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:45.781989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 925/1850] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:40:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:40:45.790886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:45.791324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:45.791517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:45.811318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:45.812577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:45.822197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 926/1851] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:45.843047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63d06-4c15-44cd-87f0-adfba26cabb5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:45.859784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f63d06-4c15-44cd-87f0-adfba26cabb5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:45.865518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:45.866399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:45.866749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:45.867114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:45.876487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:45.878135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6259909-bb31-4971-9241-79a46a538bbe service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:45.888409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 926/1852] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:49.871050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:49.872790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:49.973941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa94aa7-6b84-4ae5-8776-4e0ebcdd912d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:49.980024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:49.980914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:49.981350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:49.981909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] PATH_INFO: `/v3/users/98e8c287fb0345b2a96c54756629ec5c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:49.992494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98e8c287fb0345b2a96c54756629ec5c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:49.995175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:50.052067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98e8c287fb0345b2a96c54756629ec5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.063679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98e8c287fb0345b2a96c54756629ec5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.070290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98e8c287fb0345b2a96c54756629ec5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.070978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98e8c287fb0345b2a96c54756629ec5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.078776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98e8c287fb0345b2a96c54756629ec5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.085247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 927/1853] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:49 2022] DELETE /identity/v3/users/98e8c287fb0345b2a96c54756629ec5c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:50.089895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:50.090455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:50.090455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:50.108783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:50.110096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:50.168767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 927/1854] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:50.178448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:50.180373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:50.254170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7814a0-b290-40dd-ad8f-0445335d595d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:50.258077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:50.258738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:50.259040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:50.259638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:50.277459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:50.279004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:50.291011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 928/1855] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:50.625194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:50.626842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:50.638890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee9e07-091a-40e4-a589-bef415507290 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:50.643686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:50.644557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:50.644835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:50.645133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] PATH_INFO: `/v3/projects/73143010de794ba297ce24102ee508c4` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:50.646361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73143010de794ba297ce24102ee508c4)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:50.648316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:50.702893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73143010de794ba297ce24102ee508c4', 'request_id': 'req-66c87ecd-b085-491d-8bb1-87263bf07e66'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.708852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73143010de794ba297ce24102ee508c4', 'request_id': 'req-66c87ecd-b085-491d-8bb1-87263bf07e66'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.715347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73143010de794ba297ce24102ee508c4', 'request_id': 'req-66c87ecd-b085-491d-8bb1-87263bf07e66'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.729186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] The token cache is being invalidate because project 73143010de794ba297ce24102ee508c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:50.729617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.730401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.732369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 928/1856] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:50 2022] DELETE /identity/v3/projects/73143010de794ba297ce24102ee508c4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:50.736625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:50.747830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0279e-d329-42e1-bc08-499e553e353f service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:50.812629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:50.813510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:50.813870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:50.814132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] PATH_INFO: `/v3/users/ea5159c98f574f7f89bc9c8771e91c5d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:50.815433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5159c98f574f7f89bc9c8771e91c5d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:50.817356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:50.871890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5159c98f574f7f89bc9c8771e91c5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.885174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5159c98f574f7f89bc9c8771e91c5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.892575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5159c98f574f7f89bc9c8771e91c5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.893357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5159c98f574f7f89bc9c8771e91c5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.901351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2816c17b-30df-4ee5-a4b9-0b37240a61ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5159c98f574f7f89bc9c8771e91c5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:50.907956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 929/1857] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:50 2022] DELETE /identity/v3/users/ea5159c98f574f7f89bc9c8771e91c5d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:50.922867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:50.925083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:50.940539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87ecd-b085-491d-8bb1-87263bf07e66 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.002932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.003854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.004135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.004407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] PATH_INFO: `/v3/users/64abf2ffaffe4eefbce850620ca6fb77` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.005607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=64abf2ffaffe4eefbce850620ca6fb77)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.007550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.056202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64abf2ffaffe4eefbce850620ca6fb77'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.064629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64abf2ffaffe4eefbce850620ca6fb77'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.076157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64abf2ffaffe4eefbce850620ca6fb77'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.076981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64abf2ffaffe4eefbce850620ca6fb77'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.086873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64abf2ffaffe4eefbce850620ca6fb77'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.093297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 929/1858] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:50 2022] DELETE /identity/v3/users/64abf2ffaffe4eefbce850620ca6fb77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:51.098192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.098658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.099051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.116152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:51.117475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.175593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 930/1859] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:51.185297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.186763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.249801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec104b-5f63-41d1-baf5-a9dd839222fb admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.253792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.254562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.254907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.255241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.266119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.267649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.268528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.269291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4065cf-0408-4f0c-971e-83e6f49c9af3 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.280433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 930/1860] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:51.289633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e214a8-9bbb-44d2-a043-8c2e12d6c201 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.295428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.296376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.296655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.296933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] PATH_INFO: `/v3/projects/6cffaad26f194b6cafbb475464062ebb` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.298332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cffaad26f194b6cafbb475464062ebb)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.300298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.354759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cffaad26f194b6cafbb475464062ebb', 'request_id': 'req-19f13448-7450-4d66-bdcd-3a35ae8201e0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.361113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cffaad26f194b6cafbb475464062ebb', 'request_id': 'req-19f13448-7450-4d66-bdcd-3a35ae8201e0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.367700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cffaad26f194b6cafbb475464062ebb', 'request_id': 'req-19f13448-7450-4d66-bdcd-3a35ae8201e0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.383815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] The token cache is being invalidate because project 6cffaad26f194b6cafbb475464062ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:51.384088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.384770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-19f13448-7450-4d66-bdcd-3a35ae8201e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:51.387462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 931/1861] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:51 2022] DELETE /identity/v3/projects/6cffaad26f194b6cafbb475464062ebb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:51.393814 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.394452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.394735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.417836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:51.419056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.480698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 931/1862] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:51.489502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.489887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.490468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.518382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:51.519606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.528358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 932/1863] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:51.533804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.544630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd0417-8ee6-429f-8194-25deb05fb6cb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.549994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.550678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.551052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.551331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.552102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:51.552597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.554456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.569172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 932/1864] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:40:51.573820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.585293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6534b2-7983-46ea-8e3e-67f19abde786 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.591080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.592008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.592333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.592676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.593395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.595436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.631807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 933/1865] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:51.635884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.646417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a934ce-24d7-43d1-99a8-b5d3d3e5c630 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.712088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.712773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.713052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.713326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.714036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.716054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.739328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 933/1866] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:51.743677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.755134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35b3d3-71b1-40bf-9318-c1adb843be68 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.759721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.760425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.760704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.760974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.761732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.763330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.774375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 934/1867] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:51.778234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.789421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521b737-b842-4bec-b1a2-bc48f89b6ef3 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.794433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.795167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.795476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.795748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.796471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.798100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.809942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 934/1868] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:51.814161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.832297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea947b6-3f64-47da-abae-52fc935c2d6e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.837222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.838113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.838405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.838679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] PATH_INFO: `/v3/projects/1d302bed84434e1089efe44793d5cfa8/users/00c54721eef24b2cb6266081c860120a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.853427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d302bed84434e1089efe44793d5cfa8, user_id=00c54721eef24b2cb6266081c860120a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.856198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc69f-0220-487e-9978-059630aea586 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.865547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.867263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.875808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 935/1869] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:51 2022] PUT /identity/v3/projects/1d302bed84434e1089efe44793d5cfa8/users/00c54721eef24b2cb6266081c860120a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:51.880261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c4b05-3905-4b3d-9525-279c1b1ae361 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:51.881787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.882249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.882524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.908643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] MFA Rules not processed for user `00c54721eef24b2cb6266081c860120a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:51.909843 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.939454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:51.940417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:51.940958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:51.941084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] PATH_INFO: `/v3/projects/b63756d17a704d55bca2722ee1db4654` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:51.942450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63756d17a704d55bca2722ee1db4654)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:51.945021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:51.973081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 936/1870] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:51.984091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:51.985535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:51.998718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63756d17a704d55bca2722ee1db4654', 'request_id': 'req-3265def3-5c85-4041-a714-97520d34f90f'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.005019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63756d17a704d55bca2722ee1db4654', 'request_id': 'req-3265def3-5c85-4041-a714-97520d34f90f'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.011452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63756d17a704d55bca2722ee1db4654', 'request_id': 'req-3265def3-5c85-4041-a714-97520d34f90f'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.026006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] The token cache is being invalidate because project b63756d17a704d55bca2722ee1db4654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:52.026488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.027263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.029413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 935/1871] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:51 2022] DELETE /identity/v3/projects/b63756d17a704d55bca2722ee1db4654 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:52.033412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:52.034901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:52.044597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4d47c-5a75-4d3f-8108-33aed4aa6fee None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:52.099405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:52.100093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.100374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.100646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.102662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265def3-5c85-4041-a714-97520d34f90f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:52.103111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:52.107544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:52.108556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.108955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.109698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] PATH_INFO: `/v3/users/88d97b736ebb410ba10d24d25502172b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.110976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d97b736ebb410ba10d24d25502172b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:52.113101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:52.158321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d97b736ebb410ba10d24d25502172b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.163298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:52.164801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:52.165224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d97b736ebb410ba10d24d25502172b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.173558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 937/1872] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:40:52.176403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d97b736ebb410ba10d24d25502172b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.177094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d97b736ebb410ba10d24d25502172b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.186399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-8a0f3381-71f4-4e61-99e0-ea5e614a0fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d97b736ebb410ba10d24d25502172b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.192816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 936/1873] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:52 2022] DELETE /identity/v3/users/88d97b736ebb410ba10d24d25502172b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:52.638393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:52.651960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df02905-e6b7-444d-ba9c-4126686db541 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:52.710113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:52.710969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.711241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.711544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] PATH_INFO: `/v3/projects/0e94f3a7b6ca48358cb19127c68d3367` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.712710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e94f3a7b6ca48358cb19127c68d3367)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:52.714585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:52.767938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e94f3a7b6ca48358cb19127c68d3367', 'request_id': 'req-758b1f6b-5d58-478e-9b4c-307e899706fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.773397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e94f3a7b6ca48358cb19127c68d3367', 'request_id': 'req-758b1f6b-5d58-478e-9b4c-307e899706fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.779432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e94f3a7b6ca48358cb19127c68d3367', 'request_id': 'req-758b1f6b-5d58-478e-9b4c-307e899706fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.792419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] The token cache is being invalidate because project 0e94f3a7b6ca48358cb19127c68d3367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:52.792767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.793318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-758b1f6b-5d58-478e-9b4c-307e899706fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:52.795755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 938/1874] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:52 2022] DELETE /identity/v3/projects/0e94f3a7b6ca48358cb19127c68d3367 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:52.801009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.801321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.801606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.819283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:52.820526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:52.888718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 937/1875] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:52.897680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.898197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.898463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.917240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:52.921325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:52.931128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 939/1876] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:52.935217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:52.947100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb22ae4-1ebc-4214-87cb-11449e14c38e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:52.952658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:52.953323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.953600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.953872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.954634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:52.954938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:52.956933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:52.969233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 938/1877] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:40:52.973721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:52.983128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f163-3150-43b0-9809-97c35ca67079 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:52.988257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:52.989137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:52.989416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:52.989685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:52.990379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:52.992468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.025602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 940/1878] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:52 2022] POST /identity/v3/projects => generated 407 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:40:53.030102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.040372 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9dd7-3f28-4a4a-8191-f612d5396c51 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.099750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.100417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.100696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.100970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.101659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.103594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.124382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 939/1879] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:53 2022] POST /identity/v3/users => generated 304 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:53.128721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.139145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bd640-a89d-4918-8fd9-7d781cccbd2a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.144174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.144836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.145112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.145381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.146135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.147738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.158265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 941/1880] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:53.162200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.172102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac0b7e-4c83-47ba-ade6-0fec7e85a264 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.176897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.177556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.177841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.178115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.178836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.180456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2044a-8679-4434-b5f8-e45565765db4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.190694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 940/1881] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:53.194756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.204595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58122a8-f8ed-42e1-931f-02c4006ad350 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.209581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.210461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.210758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.211024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] PATH_INFO: `/v3/projects/522506108bcc4e5d949e53b1dbcf5859/users/8523b9847a094a0eb367015d2ef93ff8/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.226483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522506108bcc4e5d949e53b1dbcf5859, user_id=8523b9847a094a0eb367015d2ef93ff8, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.229185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.243119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 942/1882] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:53 2022] PUT /identity/v3/projects/522506108bcc4e5d949e53b1dbcf5859/users/8523b9847a094a0eb367015d2ef93ff8/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:53.253634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.253924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.254203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.280461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] MFA Rules not processed for user `8523b9847a094a0eb367015d2ef93ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:53.281651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:53.343888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 941/1883] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:53.349040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.413773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e3f81-a104-4601-aa8f-57545aca1ab7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.418925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.419613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.419895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.420168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.420847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.422743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.456800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 943/1884] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:53 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:53.461067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.471408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f0c0e-45f0-4419-8fb5-7fbbeddf2eb2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.528594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.529269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.529549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.529819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.530516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.532595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.562256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 942/1885] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:53 2022] POST /identity/v3/users => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:53.566423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.581496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479192-73f1-4597-8ed7-35c377c7f08c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.586907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.587621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.587910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.588184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.588921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.590515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.601469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 944/1886] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:53.605504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.615077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca939fc6-8010-4f0d-9541-061601321c2e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.619562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.620481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.620760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.621029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] PATH_INFO: `/v3/projects/82bf94f5558c4073b9fb62f9129a8080/users/5752d37826384e8baee5de5ba89e7355/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.635081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bf94f5558c4073b9fb62f9129a8080, user_id=5752d37826384e8baee5de5ba89e7355, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.637746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.652127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 943/1887] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:53 2022] PUT /identity/v3/projects/82bf94f5558c4073b9fb62f9129a8080/users/5752d37826384e8baee5de5ba89e7355/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:53.656185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.666582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed581aaa-c922-4bb8-a497-93aef167dfce admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.730299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.730953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.731232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.731575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.732322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.733892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a160d-a299-425c-a324-a07af18d00c3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.743684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 945/1888] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:53.747866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.762303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96cc7e-2052-4206-8081-2038e138933c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.770435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.771335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.771642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.771914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] PATH_INFO: `/v3/projects/82bf94f5558c4073b9fb62f9129a8080/users/5752d37826384e8baee5de5ba89e7355/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.774070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=82bf94f5558c4073b9fb62f9129a8080, user_id=5752d37826384e8baee5de5ba89e7355, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.776853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.796920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 944/1889] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:53 2022] PUT /identity/v3/projects/82bf94f5558c4073b9fb62f9129a8080/users/5752d37826384e8baee5de5ba89e7355/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:53.798911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.799302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.799626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.825662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] MFA Rules not processed for user `5752d37826384e8baee5de5ba89e7355`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:53.826848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:53.892466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 946/1890] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:53.903754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:53.906773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:53.968493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5477f-c119-4f2f-8b2f-05448d1ecb2b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:53.972441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:53.973077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:53.973352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:53.973623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:53.982750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:53.984230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f697a-da75-4ff2-928a-2a61749584bc service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:53.993625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 945/1891] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:54.185518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:54.195113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bb12f-4436-46e2-a650-115b0282b9d9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:54.198787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:54.199396 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:54.199705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:54.199980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:54.256962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:54.259794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:54.271914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 947/1892] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:54 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:56.732977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda3fd-1caa-4376-bba6-7963e89b34ff None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:56.732977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda3fd-1caa-4376-bba6-7963e89b34ff None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:56.733627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda3fd-1caa-4376-bba6-7963e89b34ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:56.762684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-30bda3fd-1caa-4376-bba6-7963e89b34ff None None] MFA Rules not processed for user `00c54721eef24b2cb6266081c860120a`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:56.770266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-30bda3fd-1caa-4376-bba6-7963e89b34ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:56.895019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 946/1893] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:57.251402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:57.253362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:57.336616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f12e26-3042-471d-ab27-b2f6b371a49f service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:57.341433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:57.342492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:57.342930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:57.343349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] PATH_INFO: `/v3/users/44c36b885fd74e4fa05299d8bf5d710a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:57.344783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c36b885fd74e4fa05299d8bf5d710a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:57.346875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:57.537027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c36b885fd74e4fa05299d8bf5d710a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:57.557782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c36b885fd74e4fa05299d8bf5d710a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:57.567269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c36b885fd74e4fa05299d8bf5d710a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:57.568504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c36b885fd74e4fa05299d8bf5d710a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:57.581343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c36b885fd74e4fa05299d8bf5d710a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:57.588806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 948/1894] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:57 2022] DELETE /identity/v3/users/44c36b885fd74e4fa05299d8bf5d710a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:57.593096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:57.593392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:57.593666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:57.620902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:57.635781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:57.716373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 947/1895] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:57.728839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:57.730388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:57.813866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb89240-e0be-4591-85ab-5dc124dacdfe admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:57.825052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:57.825967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:57.826266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:57.826518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:57.839113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:57.840761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:57.850511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 949/1896] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:58.241795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:58.244263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:58.261613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec6030-60ab-4cb5-9c08-4b39e64158e7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:58.269835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:58.270703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:58.271148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:58.271506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] PATH_INFO: `/v3/projects/78f6f904e8b148e5879aa3b598c624f3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:58.272971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f6f904e8b148e5879aa3b598c624f3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:58.274857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:58.331622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f6f904e8b148e5879aa3b598c624f3', 'request_id': 'req-ef7cc844-f032-4307-b4b8-f79427e113a0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.342698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f6f904e8b148e5879aa3b598c624f3', 'request_id': 'req-ef7cc844-f032-4307-b4b8-f79427e113a0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.349949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f6f904e8b148e5879aa3b598c624f3', 'request_id': 'req-ef7cc844-f032-4307-b4b8-f79427e113a0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.367847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] The token cache is being invalidate because project 78f6f904e8b148e5879aa3b598c624f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:58.368207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.368785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.370335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 948/1897] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:58 2022] DELETE /identity/v3/projects/78f6f904e8b148e5879aa3b598c624f3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:58.374303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:58.384130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eca19c-045f-40a7-97c5-3305de1f7c74 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:58.438686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:58.439469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:58.439749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:58.440025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] PATH_INFO: `/v3/users/9375d8b419194a8189be14aee337b9c6` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:58.441221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9375d8b419194a8189be14aee337b9c6)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:58.443127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:58.492314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9375d8b419194a8189be14aee337b9c6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.504154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9375d8b419194a8189be14aee337b9c6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.511982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9375d8b419194a8189be14aee337b9c6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.512722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9375d8b419194a8189be14aee337b9c6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.521731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-491e6eb3-3c41-462e-8189-a3c924bd7720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9375d8b419194a8189be14aee337b9c6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.527795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 950/1898] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:58 2022] DELETE /identity/v3/users/9375d8b419194a8189be14aee337b9c6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:40:58.800728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:58.802342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:58.821476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cc844-f032-4307-b4b8-f79427e113a0 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:58.900301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:58.901274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:58.901624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:58.901962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] PATH_INFO: `/v3/projects/d9dd31a8cdf141999dd95cc439e8b277` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:58.903231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9dd31a8cdf141999dd95cc439e8b277)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:58.905239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:58.955492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9dd31a8cdf141999dd95cc439e8b277', 'request_id': 'req-05b07218-5ab1-46b5-939d-0370258d7834'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.960914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9dd31a8cdf141999dd95cc439e8b277', 'request_id': 'req-05b07218-5ab1-46b5-939d-0370258d7834'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.967003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9dd31a8cdf141999dd95cc439e8b277', 'request_id': 'req-05b07218-5ab1-46b5-939d-0370258d7834'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.981233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] The token cache is being invalidate because project d9dd31a8cdf141999dd95cc439e8b277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:40:58.981526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.982158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-05b07218-5ab1-46b5-939d-0370258d7834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:58.984019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 949/1899] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:40:58 2022] DELETE /identity/v3/projects/d9dd31a8cdf141999dd95cc439e8b277 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:58.988731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:58.989022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:58.989299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.007259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:59.008475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.064430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 951/1900] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:40:59.072391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.072683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.072960 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.091307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:59.092548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.103813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 950/1901] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:59.108061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.117997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361a0a1-4646-4957-b654-9ddf9f99aec6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.123525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.124182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.124460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.124727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.125449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:40:59.125781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.127481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.139543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 952/1902] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:40:59.143866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.153132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac1d3e-a4a3-4f17-b797-5f529b548f0a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.158343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.158993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.159353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.160997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.160997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.162362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.190796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 951/1903] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:40:59 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:59.195221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.205660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480838-6c2e-4fc7-bdf1-b5c76c340797 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.266802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.267516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.267801 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.268076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.268804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.270723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.294530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 953/1904] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:40:59 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:40:59.295855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.306108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373ab4e-1b03-45ea-9241-2411a3976206 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.310686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.311345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.311660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.311928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.312645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.314246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.327821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 952/1905] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:40:59.328992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.339118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ab0fe-3fc7-489b-a2ce-10cc47b6a216 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.344119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.344812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.345091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.345362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.346084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.347726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f26c7cb-d549-4baa-88fd-9aa94fa0de14 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.357359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 954/1906] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:40:59.361380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.372193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e4744-4e6e-4cda-b538-92fd269400ff admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.377085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.377952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.378231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.378503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] PATH_INFO: `/v3/projects/f1fe5e93d23a45f48a03b84ab979429f/users/b8c098bb250e43c69747bade80f107c5/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.394394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fe5e93d23a45f48a03b84ab979429f, user_id=b8c098bb250e43c69747bade80f107c5, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.397082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.412976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 953/1907] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:40:59 2022] PUT /identity/v3/projects/f1fe5e93d23a45f48a03b84ab979429f/users/b8c098bb250e43c69747bade80f107c5/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:59.423966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.424457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.424457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.451082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] MFA Rules not processed for user `b8c098bb250e43c69747bade80f107c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:59.452305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.521392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 955/1908] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:59.532770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.534523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.589066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d733c5-07cb-462e-a524-822df7672041 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.592744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.593415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.593693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.593965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.602897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.604416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137b816-a295-422e-a8d8-1ad419e1faa1 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.613072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 954/1909] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:40:59.631974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.697064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c2492-8791-4ca4-acf7-10b76bc0723f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.702206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.703087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.703363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.703657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] PATH_INFO: `/v3/users/b8c098bb250e43c69747bade80f107c5` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.705446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c098bb250e43c69747bade80f107c5)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.707404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.759481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c098bb250e43c69747bade80f107c5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:59.771893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c098bb250e43c69747bade80f107c5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:59.779502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c098bb250e43c69747bade80f107c5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:59.780359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c098bb250e43c69747bade80f107c5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:59.789176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c098bb250e43c69747bade80f107c5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:40:59.795868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 956/1910] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:40:59 2022] DELETE /identity/v3/users/b8c098bb250e43c69747bade80f107c5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:40:59.801671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.802196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.802676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.821951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:40:59.823163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.882605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 955/1911] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:40:59.892491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:40:59.894123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:40:59.954149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f5034-7ba1-4724-9da2-b60e3443e277 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:40:59.958438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:40:59.959094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:40:59.959365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:40:59.959795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:40:59.968865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:40:59.970359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01a6c8-d1eb-4d27-a18c-7ae5441842b9 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:40:59.979998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 957/1912] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:00.324865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.326302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:00.338724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d308ff9-8e74-46c2-9552-f6f3274d1e73 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.345050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.345920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.346213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.346524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] PATH_INFO: `/v3/projects/f1fe5e93d23a45f48a03b84ab979429f` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.347980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fe5e93d23a45f48a03b84ab979429f)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.350167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.398562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fe5e93d23a45f48a03b84ab979429f', 'request_id': 'req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:00.404328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fe5e93d23a45f48a03b84ab979429f', 'request_id': 'req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:00.411299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fe5e93d23a45f48a03b84ab979429f', 'request_id': 'req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:00.424327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] The token cache is being invalidate because project f1fe5e93d23a45f48a03b84ab979429f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:00.424621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:00.425230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5fba2dc2-d20b-44df-a312-3b8cbc1b8b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:00.426789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 956/1913] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:00 2022] DELETE /identity/v3/projects/f1fe5e93d23a45f48a03b84ab979429f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:00.431732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.432211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.432426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.454494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:00.456029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:00.514574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 958/1914] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:00.522383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.522614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.522909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.541320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:00.542504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:00.550779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 957/1915] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:00.555065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.564723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ee229-0c5c-47b7-a9a2-377c90742d2d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.569452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.570096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.570372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.570640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.571398 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:00.571713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.573612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.585272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 959/1916] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:41:00.589483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.598755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043c57b-9c3c-482e-9906-703d511e7ea2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.603552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.604205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.604485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.604761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.605436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.607337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.633591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 958/1917] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:00 2022] POST /identity/v3/projects => generated 359 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:00.637832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.648023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67722379-71d4-4fa7-acd2-bc1c4f37d5a9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.703849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.704555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.704830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.705100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.706132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.708098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.728495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 960/1918] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:00 2022] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:00.732619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.742949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a27352-af28-4650-a5d2-0e5dd8cc5473 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.747729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.748379 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.748637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.748900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.749617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.751237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.761436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 959/1919] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:00.765453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.778915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9bdf-f8a5-4f45-87f0-099ac5a98ddc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.784560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.785210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.785491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.785762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.786491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.788128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be45d74-caed-4769-9d93-e01fa6cda21f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.798358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 961/1920] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:00.802789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.814014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d7c4e-0145-464f-b57f-fba235a6ea85 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:00.819344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:00.820318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.820688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.820935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] PATH_INFO: `/v3/projects/6b57e6a5811b44e0aa3d412ceffe48de/users/657215f1732249a7bc476463bbbfa447/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.836299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b57e6a5811b44e0aa3d412ceffe48de, user_id=657215f1732249a7bc476463bbbfa447, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:00.838933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:00.853470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 960/1921] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:00 2022] PUT /identity/v3/projects/6b57e6a5811b44e0aa3d412ceffe48de/users/657215f1732249a7bc476463bbbfa447/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:00.864283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:00.864574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:00.864859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:00.892907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] MFA Rules not processed for user `657215f1732249a7bc476463bbbfa447`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:00.894170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:00.957065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 962/1922] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:00 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:00.988304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:00.990131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:01.050673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0cd1e-7d93-436e-9069-4868f3b0ae23 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:01.055189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:01.056081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:01.056364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:01.056635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:01.067910 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:01.068156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd2ec9-5603-450a-b40d-d96a71cda2d5 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:01.077283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 961/1923] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:01.091412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:01.153944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fb9f1-b511-4ec0-b198-44eb1be65667 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:01.158783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:01.159812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:01.160113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:01.160693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] PATH_INFO: `/v3/users/657215f1732249a7bc476463bbbfa447` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:01.161642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657215f1732249a7bc476463bbbfa447)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:01.163544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:01.233069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657215f1732249a7bc476463bbbfa447'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.251128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657215f1732249a7bc476463bbbfa447'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.258756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657215f1732249a7bc476463bbbfa447'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.260504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657215f1732249a7bc476463bbbfa447'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.271459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657215f1732249a7bc476463bbbfa447'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.277889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 963/1924] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:01 2022] DELETE /identity/v3/users/657215f1732249a7bc476463bbbfa447 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:01.283116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:01.283553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:01.283929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:01.311622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:01.312939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:01.371132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 962/1925] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:01.381917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:01.383583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:01.450547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e5ae1-5132-4a78-9ebd-580d991a78b0 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:01.457663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:01.457663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:01.457663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:01.457663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:01.468418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:01.469973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1de34-4ac4-4b35-a0cb-99f12fd5f1bb service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:01.483053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 964/1926] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:01.820034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:01.821560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:01.843886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42e03d-bbd4-4451-b435-1fe32086594d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:01.852121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:01.853097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:01.853575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:01.853904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] PATH_INFO: `/v3/projects/6b57e6a5811b44e0aa3d412ceffe48de` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:01.855306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b57e6a5811b44e0aa3d412ceffe48de)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:01.857331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:01.970822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b57e6a5811b44e0aa3d412ceffe48de', 'request_id': 'req-62ecb5fc-c8b3-41d5-8d5c-de311570007b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.978159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b57e6a5811b44e0aa3d412ceffe48de', 'request_id': 'req-62ecb5fc-c8b3-41d5-8d5c-de311570007b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:01.987456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b57e6a5811b44e0aa3d412ceffe48de', 'request_id': 'req-62ecb5fc-c8b3-41d5-8d5c-de311570007b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:02.011011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] The token cache is being invalidate because project 6b57e6a5811b44e0aa3d412ceffe48de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:02.011341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:02.012670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-62ecb5fc-c8b3-41d5-8d5c-de311570007b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:02.016920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 963/1927] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:01 2022] DELETE /identity/v3/projects/6b57e6a5811b44e0aa3d412ceffe48de => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:02.022850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.023868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.024496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.060001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:02.061320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:02.126370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 965/1928] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:02.135182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.135502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.135792 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.157729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:02.159041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:02.173426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 964/1929] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:02.174540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.196496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a0c261-c784-4716-9c2b-7d74589a7754 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.202349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.203078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.203301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.203609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.204393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:02.205498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.207980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.225393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 966/1930] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:02.229358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.239701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae6613-d0de-49fe-8e77-0a107d56801c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.246156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.246839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.247176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.247431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.249707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.252252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.287576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 965/1931] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:02 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:41:02.288602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.298632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42750-879c-4a45-9953-6ee1f2a8961b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.367318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.368107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.368489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.368854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.369659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.371889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.415427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 967/1932] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:02 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:02.417760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.428334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8bfb-28ae-4ecb-9eda-a85de0b3a66f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.433405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.434155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.434503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.434828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.435810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.437582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.449373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 966/1933] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:02.453383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.470442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb4ab9-d5c3-4aad-acce-2ca42e6b23f3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.477539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.478445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.478902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.479558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.480540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.482441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387084ff-85a4-4787-8dcd-e9a056e1c74a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.494890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 968/1934] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:02.499421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.516483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005fadd-a2a0-45bf-a149-70dffe5e7285 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.522278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.523610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.524035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.524450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] PATH_INFO: `/v3/projects/55d688f723364f99a6e367a3a345a24b/users/222b5f69122c49b18528c88e6f80a7f3/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.542609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d688f723364f99a6e367a3a345a24b, user_id=222b5f69122c49b18528c88e6f80a7f3, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.546199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.581208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 967/1935] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:02 2022] PUT /identity/v3/projects/55d688f723364f99a6e367a3a345a24b/users/222b5f69122c49b18528c88e6f80a7f3/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:02.599590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.599927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.600205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.635042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] MFA Rules not processed for user `222b5f69122c49b18528c88e6f80a7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:02.636147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:02.758079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 969/1936] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:02.769943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:02.771862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:02.851356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef87c-4ee1-4ff2-a5c2-dcd44203c5a8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:02.856021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:02.856892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:02.857272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:02.857694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:02.867586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:02.869670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45a4be-ad2f-4ff0-bfab-f0cd0a12cf62 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:02.879710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 968/1937] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:03.764070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:03.765704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:03.835101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ade00-61e2-4ad9-a3a2-50eeb843e4c2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:03.841571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:03.842599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:03.842885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:03.843429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] PATH_INFO: `/v3/users/fbed5f5a2c8d4a63903c1f543322b63d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:03.846012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbed5f5a2c8d4a63903c1f543322b63d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:03.848275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:03.907460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbed5f5a2c8d4a63903c1f543322b63d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:03.922057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbed5f5a2c8d4a63903c1f543322b63d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:03.935287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbed5f5a2c8d4a63903c1f543322b63d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:03.935287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbed5f5a2c8d4a63903c1f543322b63d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:03.944954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbed5f5a2c8d4a63903c1f543322b63d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:03.961196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 970/1938] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:03 2022] DELETE /identity/v3/users/fbed5f5a2c8d4a63903c1f543322b63d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:03.966393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:03.967877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:03.968449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:04.020138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:04.021254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:04.141632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 969/1939] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:04.152764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:04.154645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:04.217447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec950e-fa75-45d1-9c8f-563fa5f536a7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:04.221132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:04.221784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:04.222061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:04.222335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:04.231671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:04.233333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:04.243275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 971/1940] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:04.665653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:04.666995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:04.701558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3595b-ce72-4751-9871-6143067beedb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:04.722016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:04.722576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:04.722846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:04.723116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] PATH_INFO: `/v3/projects/a0cb64e01ea1486db3e5094213523205` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:04.724389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0cb64e01ea1486db3e5094213523205)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:04.726348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:04.842044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0cb64e01ea1486db3e5094213523205', 'request_id': 'req-a4eceadf-44a7-483d-a10d-38fa818cc1f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:04.852574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0cb64e01ea1486db3e5094213523205', 'request_id': 'req-a4eceadf-44a7-483d-a10d-38fa818cc1f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:04.860350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0cb64e01ea1486db3e5094213523205', 'request_id': 'req-a4eceadf-44a7-483d-a10d-38fa818cc1f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:04.874445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] The token cache is being invalidate because project a0cb64e01ea1486db3e5094213523205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:04.874733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:04.875537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:04.877282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 970/1941] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:04 2022] DELETE /identity/v3/projects/a0cb64e01ea1486db3e5094213523205 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:04.881335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:04.890747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245b7fd-d059-4206-ab19-541f863953d3 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:04.952082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:04.953267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:04.953550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:04.953848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] PATH_INFO: `/v3/users/16a292c525c741f589c51d3aad6822ee` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:04.955468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a292c525c741f589c51d3aad6822ee)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:04.957527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.007871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a292c525c741f589c51d3aad6822ee'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.019411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a292c525c741f589c51d3aad6822ee'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.025873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a292c525c741f589c51d3aad6822ee'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.026625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a292c525c741f589c51d3aad6822ee'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.034258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a292c525c741f589c51d3aad6822ee'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.040334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 972/1942] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:04 2022] DELETE /identity/v3/users/16a292c525c741f589c51d3aad6822ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:05.343800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.345623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.362545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.364195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.372803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eceadf-44a7-483d-a10d-38fa818cc1f8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.436297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a065f-016f-4e5d-ae0b-116079fadeb3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.441213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.442077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.442351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.442617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] PATH_INFO: `/v3/projects/c76a0e8687724b9db65e94f6a3906b1c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.444257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76a0e8687724b9db65e94f6a3906b1c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.446157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.450589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.451581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.451923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.452276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] PATH_INFO: `/v3/users/8523b9847a094a0eb367015d2ef93ff8` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.453506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8523b9847a094a0eb367015d2ef93ff8)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.455982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.502000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76a0e8687724b9db65e94f6a3906b1c', 'request_id': 'req-8f601548-2c0d-4df3-9eb1-f3268217fae0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.509287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76a0e8687724b9db65e94f6a3906b1c', 'request_id': 'req-8f601548-2c0d-4df3-9eb1-f3268217fae0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.511090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8523b9847a094a0eb367015d2ef93ff8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.515703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76a0e8687724b9db65e94f6a3906b1c', 'request_id': 'req-8f601548-2c0d-4df3-9eb1-f3268217fae0'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.518575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8523b9847a094a0eb367015d2ef93ff8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.529696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] The token cache is being invalidate because project c76a0e8687724b9db65e94f6a3906b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:05.529994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.530827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8f601548-2c0d-4df3-9eb1-f3268217fae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.532680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 973/1943] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:05 2022] DELETE /identity/v3/projects/c76a0e8687724b9db65e94f6a3906b1c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:05.535897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8523b9847a094a0eb367015d2ef93ff8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.536824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8523b9847a094a0eb367015d2ef93ff8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.537620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05473a-c76c-4af1-9db4-24057db68b01 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.537911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05473a-c76c-4af1-9db4-24057db68b01 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.538189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05473a-c76c-4af1-9db4-24057db68b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.547516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7f069d4e-d552-4e35-a8ab-8045abf47aa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8523b9847a094a0eb367015d2ef93ff8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:05.554620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 971/1944] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:05 2022] DELETE /identity/v3/users/8523b9847a094a0eb367015d2ef93ff8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:05.557628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-cc05473a-c76c-4af1-9db4-24057db68b01 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:05.558845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cc05473a-c76c-4af1-9db4-24057db68b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.559252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.559693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.560152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.577965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:05.579595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.615691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 974/1945] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:05.623606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.623913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.624190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.636583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 972/1946] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:05.641762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:05.642965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.646483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.647869 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:05.651179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 975/1947] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:05.654962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.664004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ea900-89ff-4aae-9b22-9737f6673347 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.669361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.670110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.670452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.670790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.671623 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:05.671978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.673715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.685431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 976/1948] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:41:05.689965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.699410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c80e23-276d-4ff2-a489-fb7ef565d835 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.704271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.704936 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.705540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.705886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ac81a-b873-406f-a393-206027bae3a2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.705986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.706608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.708629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.709542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.710300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.710471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.710748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.724291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.725965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.736494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 973/1949] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:05.739327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 977/1950] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:41:05.743706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.754029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e0682-6cba-425b-9931-48bbd8036408 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.821464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.822183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.822465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.822872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.823630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.825588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.849373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 974/1951] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:05.850796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.860685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a40b6-345e-414d-a9f6-e91ac5981e4b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.865275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.865933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.866206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.866471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.867191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.868805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.878714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 978/1952] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:05.882806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.897453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92dd8c6-f43a-4261-a973-1271eebcc9d7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.902118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.902780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.903058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.903332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.904076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.905667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372e9ff-522c-4612-a1e4-1f11726be297 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.916250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 975/1953] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:05.920329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:05.931124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60aa4ed-b077-4afc-9cbb-91d905688245 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:05.936014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:05.936930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.937219 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.937472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] PATH_INFO: `/v3/projects/6d109bcd9117440cb8930c9921ef70f4/users/104e123457f64b78b30afba5f9d610ad/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:05.954919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d109bcd9117440cb8930c9921ef70f4, user_id=104e123457f64b78b30afba5f9d610ad, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:05.957904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:05.971030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 979/1954] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:05 2022] PUT /identity/v3/projects/6d109bcd9117440cb8930c9921ef70f4/users/104e123457f64b78b30afba5f9d610ad/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:05.982163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:05.982446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:05.983195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.011798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.013544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.014084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] MFA Rules not processed for user `104e123457f64b78b30afba5f9d610ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:06.014831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.087456 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359e522-e5a7-4f0a-baa7-91f62fab79c1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.088224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 976/1955] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:06.092045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.092376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.092910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.093192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.093467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] PATH_INFO: `/v3/projects/522506108bcc4e5d949e53b1dbcf5859` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.093929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.094690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=522506108bcc4e5d949e53b1dbcf5859)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.096624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.106566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe6a7-6d77-4e3c-87a4-557251cf2074 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.111354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.112254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.112527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.112793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] PATH_INFO: `/v3/users/222b5f69122c49b18528c88e6f80a7f3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.114021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=222b5f69122c49b18528c88e6f80a7f3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.115948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.143466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522506108bcc4e5d949e53b1dbcf5859', 'request_id': 'req-02deb783-2c7e-448a-b504-7a96831c4b7e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.149247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522506108bcc4e5d949e53b1dbcf5859', 'request_id': 'req-02deb783-2c7e-448a-b504-7a96831c4b7e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.155300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522506108bcc4e5d949e53b1dbcf5859', 'request_id': 'req-02deb783-2c7e-448a-b504-7a96831c4b7e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.161972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222b5f69122c49b18528c88e6f80a7f3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.167683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] The token cache is being invalidate because project 522506108bcc4e5d949e53b1dbcf5859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:06.167965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.168588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.168944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222b5f69122c49b18528c88e6f80a7f3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.170336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 980/1956] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:06 2022] DELETE /identity/v3/projects/522506108bcc4e5d949e53b1dbcf5859 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:06.171025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.172307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.181884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222b5f69122c49b18528c88e6f80a7f3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.182737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222b5f69122c49b18528c88e6f80a7f3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.190587 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222b5f69122c49b18528c88e6f80a7f3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.196728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 977/1957] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:06 2022] DELETE /identity/v3/users/222b5f69122c49b18528c88e6f80a7f3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:06.200343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.201674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.234923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb783-2c7e-448a-b504-7a96831c4b7e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.269731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddf3e6-7008-404c-bd2b-0ffdbb928894 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.274532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.275470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.275744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.276009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] PATH_INFO: `/v3/users/5752d37826384e8baee5de5ba89e7355` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.277204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5752d37826384e8baee5de5ba89e7355)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.279114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.289337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.290039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.290325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.290602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.291291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.293223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57567a18-5d94-46e5-846f-c38b7f248460 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.319524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 981/1958] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:06 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:06.321482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.321767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.322477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.324640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5752d37826384e8baee5de5ba89e7355'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.331759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5752d37826384e8baee5de5ba89e7355'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.343447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:06.343782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5752d37826384e8baee5de5ba89e7355'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.344559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5752d37826384e8baee5de5ba89e7355'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.345146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.352914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5752d37826384e8baee5de5ba89e7355'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.362360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 978/1959] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:06 2022] DELETE /identity/v3/users/5752d37826384e8baee5de5ba89e7355 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:06.362360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.362360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.424945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 982/1960] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:06.429088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4821340b-6965-41d4-b15b-782210911d7c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.434585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.435316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.435625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.435898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.436591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.438759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.440266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.442096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.460791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 979/1961] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:06 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:06.464479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.475656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374b06d-da24-4029-af6b-9b119d22bc31 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.481331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.482121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.482550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.482843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.483873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.486150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.500897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 980/1962] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:06.501771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.518986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f12f8e-8d6a-40f4-91de-e512493e6c41 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.527958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793b567-6cef-4290-a976-a06863e06b24 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.529467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.530445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.530790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.531420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] PATH_INFO: `/v3/projects/101dda93d64549f1b6ab43583b18cc39/users/d4951590a9c2461db298c7873d53dcaf/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.563557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] RBAC: Authorizing `identity:create_grant(project_id=101dda93d64549f1b6ab43583b18cc39, user_id=d4951590a9c2461db298c7873d53dcaf, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.576423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.582281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.583671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.584257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.584742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.596566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 981/1963] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:06 2022] PUT /identity/v3/projects/101dda93d64549f1b6ab43583b18cc39/users/d4951590a9c2461db298c7873d53dcaf/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:06.599172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.600189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.602430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.615138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 983/1964] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:06.679169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14633877-c887-4848-add1-45e0b9ac780c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.685213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.685892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.686210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.686524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.687269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.688958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.701660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 982/1965] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:06.706168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.718450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1237c6-e6f4-4238-b492-042a6d2e0514 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.720528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.722573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.730724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.733680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.734581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.734931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] PATH_INFO: `/v3/projects/101dda93d64549f1b6ab43583b18cc39/users/d4951590a9c2461db298c7873d53dcaf/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.738101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101dda93d64549f1b6ab43583b18cc39, user_id=d4951590a9c2461db298c7873d53dcaf, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.741417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323044ed-d320-44a6-8984-2c346fe75fa1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.745863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b742b-458f-4a4b-ba99-c2090ca62f1c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:06.757524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 984/1966] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:06 2022] PUT /identity/v3/projects/101dda93d64549f1b6ab43583b18cc39/users/d4951590a9c2461db298c7873d53dcaf/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:06.765969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:06.765969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.765969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.765969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] PATH_INFO: `/v3/projects/82bf94f5558c4073b9fb62f9129a8080` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.766460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82bf94f5558c4073b9fb62f9129a8080)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:06.767476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.767761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.768035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.770554 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:06.801644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] MFA Rules not processed for user `d4951590a9c2461db298c7873d53dcaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:06.803033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.853029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82bf94f5558c4073b9fb62f9129a8080', 'request_id': 'req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.861473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82bf94f5558c4073b9fb62f9129a8080', 'request_id': 'req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.869168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82bf94f5558c4073b9fb62f9129a8080', 'request_id': 'req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.889668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] The token cache is being invalidate because project 82bf94f5558c4073b9fb62f9129a8080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:06.889965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.890642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f875d494-f4ce-4499-8d12-f6c0b3d9ea3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:06.892584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 983/1967] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:06 2022] DELETE /identity/v3/projects/82bf94f5558c4073b9fb62f9129a8080 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:06.896885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 985/1968] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:06.897279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50bd1-f8d2-460e-b1e1-5e22dc865de3 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:06.897578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50bd1-f8d2-460e-b1e1-5e22dc865de3 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:06.897857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b50bd1-f8d2-460e-b1e1-5e22dc865de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:06.909740 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:06.911335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.915671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-92b50bd1-f8d2-460e-b1e1-5e22dc865de3 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:06.916934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-92b50bd1-f8d2-460e-b1e1-5e22dc865de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:06.980119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d9154-4814-460f-9e08-3a42cbccd024 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.000218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 984/1969] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:07.010744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.011195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.011644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.032817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.034129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.042955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.043654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.043933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.044204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.046015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.047500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 985/1970] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.048545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.058212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111671f6-edc3-495b-914b-8ae95af39674 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.063548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.064348 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.064751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.065081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.065903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:07.066278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.067990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.087283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 986/1971] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:07.089059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.099237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbf59b-54e8-4974-a7a6-ec4d24578211 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.104303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.104985 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.105256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.105688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.106254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.108532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.117812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.119337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.139525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 986/1972] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:07.145712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 987/1973] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:07.147343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.160010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf3bf3-e84e-4ff9-917c-270e5d72e25b service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.218861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.220769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.235281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.236069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.236905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.237193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.237904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.244215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.270715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 987/1974] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:07.271935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.284643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3698e48f-c36c-4ca0-a866-3da2e8c26d54 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.291504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.292182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.292502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.292771 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.294104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.295901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.312080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 988/1975] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:07.313459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.317539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78c58c-a040-468f-991e-090d4d747db8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.324436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc183e-9b13-4bca-98e9-39804bdc4454 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.326858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.333877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.334449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.334732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] PATH_INFO: `/v3/users/104e123457f64b78b30afba5f9d610ad` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.336862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104e123457f64b78b30afba5f9d610ad)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.338149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.339078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.339534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.340017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.340130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.340989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.344461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.363190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 989/1976] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:07.364606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.368051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.383111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187e4e4-f4b0-4e32-914e-7f17d38aa9be admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.389550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.390486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.390769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.391088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] PATH_INFO: `/v3/projects/55d688f723364f99a6e367a3a345a24b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.392334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d688f723364f99a6e367a3a345a24b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.394579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.414357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104e123457f64b78b30afba5f9d610ad'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.439192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104e123457f64b78b30afba5f9d610ad'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.460838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104e123457f64b78b30afba5f9d610ad'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.461602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104e123457f64b78b30afba5f9d610ad'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.463749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d688f723364f99a6e367a3a345a24b', 'request_id': 'req-43cf363b-410a-4a88-bc45-17d26b31017d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.472452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104e123457f64b78b30afba5f9d610ad'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.475330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d688f723364f99a6e367a3a345a24b', 'request_id': 'req-43cf363b-410a-4a88-bc45-17d26b31017d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.484844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 988/1977] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:07 2022] DELETE /identity/v3/users/104e123457f64b78b30afba5f9d610ad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:07.485043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d688f723364f99a6e367a3a345a24b', 'request_id': 'req-43cf363b-410a-4a88-bc45-17d26b31017d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.486934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.489937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.502546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] The token cache is being invalidate because project 55d688f723364f99a6e367a3a345a24b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:07.503081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.503776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43cf363b-410a-4a88-bc45-17d26b31017d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:07.505473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 990/1978] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:07 2022] DELETE /identity/v3/projects/55d688f723364f99a6e367a3a345a24b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:07.511576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4aca9-3eb4-4fe8-b882-7f4e6e1a764d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.511576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4aca9-3eb4-4fe8-b882-7f4e6e1a764d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.511576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4aca9-3eb4-4fe8-b882-7f4e6e1a764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.535521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-fba4aca9-3eb4-4fe8-b882-7f4e6e1a764d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.537226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fba4aca9-3eb4-4fe8-b882-7f4e6e1a764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.595784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371caa-cb93-4ab9-b6b4-38db63b04623 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.601961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.602861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.603139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.603441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] PATH_INFO: `/v3/projects/df1dc421248b47bb8192bf7142e9be75/users/acc3647000404a3a937c4d3ab1b1e0e8/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.604313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 991/1979] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.605710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.606000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.606275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.624345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.625303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1dc421248b47bb8192bf7142e9be75, user_id=acc3647000404a3a937c4d3ab1b1e0e8, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.625580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.628418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229663ee-2d9c-4611-8af5-773474e4c38e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.634033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 992/1980] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.634918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.636373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.648694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 989/1981] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:07 2022] PUT /identity/v3/projects/df1dc421248b47bb8192bf7142e9be75/users/acc3647000404a3a937c4d3ab1b1e0e8/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:07.650732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358c6-8cb4-4190-b560-f1a6782bd833 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.651224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358c6-8cb4-4190-b560-f1a6782bd833 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.651846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358c6-8cb4-4190-b560-f1a6782bd833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.671021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-307358c6-8cb4-4190-b560-f1a6782bd833 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.672498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-307358c6-8cb4-4190-b560-f1a6782bd833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.698563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f95dc-e80b-4616-8828-9f1d08813c3b None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.741283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 990/1982] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.743169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.747774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.748129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.751416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.752407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.752689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.752964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.764448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.765810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.775538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] MFA Rules not processed for user `acc3647000404a3a937c4d3ab1b1e0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:07.776317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 993/1983] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:07.776787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.776977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.786271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d968097-ef02-4030-b272-669193bc524f service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.791168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.791859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.792142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.792420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.793505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:07.793811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.795412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.815568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 994/1984] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:07.816872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.829861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642699b-efc1-4ced-a8a9-21ca4ce12cf1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.836238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.837011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.837296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.837577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.838277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.840221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.852590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 991/1985] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:07.857184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.858719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:07.871544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 995/1986] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:41:07.873046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b183-edd1-462a-9ece-b1a57823defe None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.874796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:07.966973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.967764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.968053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.969850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.972074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.972742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7b322-a9af-4ebe-bc77-d197f6e439ff admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:07.976410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:07.978889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:07.979606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:07.980550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:07.981091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:07.981513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:07.983904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.015119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 996/1987] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:08.016651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.031434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 992/1988] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:07 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:08.034621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.067881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703592e-0511-45cb-ba63-fad65300f5c2 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.141199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adce493-0d04-4b77-97fc-4fe5b4b760b1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.146726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.147427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.148082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.148082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.148819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.150746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.180997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 993/1989] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:08 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:41:08.189365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.224064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e0473-8426-47fb-abaf-3b1a2611ae39 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.235584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.236445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.236737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.237016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.237768 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.237990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.238691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.238974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.239253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.239347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.240022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.246859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.279441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 994/1990] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:08.282711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.294711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 997/1991] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:08.303007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e783f-7da1-4448-b6fa-36ed233cc635 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.306036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.311859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.312514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.316057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.316595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.317728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.319847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.325814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.335744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 995/1992] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:08.340202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.355783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a37b28-406e-4666-9255-533c6739cce8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.362110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.362826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.363105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.363399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.364130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.367911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.372765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c56cc-8673-477d-959d-0c31c1811cc8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.387171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 996/1993] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:08.388054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.388432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.389316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.390075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.390356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] PATH_INFO: `/v3/projects/6d109bcd9117440cb8930c9921ef70f4` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.393192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d109bcd9117440cb8930c9921ef70f4)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.397527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.400365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aaa455-68cc-4261-a458-81e7c52e416e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.405672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.406677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.406958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.407317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] PATH_INFO: `/v3/projects/620bc08114f648518fb6c17e6ddda5a5/users/4000d0dd1cff46f79de3425acf536019/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.436305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=620bc08114f648518fb6c17e6ddda5a5, user_id=4000d0dd1cff46f79de3425acf536019, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.444433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.468681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 997/1994] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:08 2022] PUT /identity/v3/projects/620bc08114f648518fb6c17e6ddda5a5/users/4000d0dd1cff46f79de3425acf536019/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:08.469592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.471630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d109bcd9117440cb8930c9921ef70f4', 'request_id': 'req-236fa4e2-7444-421c-9027-e63cfba6ac87'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.477829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d109bcd9117440cb8930c9921ef70f4', 'request_id': 'req-236fa4e2-7444-421c-9027-e63cfba6ac87'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.484866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d109bcd9117440cb8930c9921ef70f4', 'request_id': 'req-236fa4e2-7444-421c-9027-e63cfba6ac87'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.508851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] The token cache is being invalidate because project 6d109bcd9117440cb8930c9921ef70f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:08.509147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.511019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-236fa4e2-7444-421c-9027-e63cfba6ac87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.517493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 998/1995] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:08 2022] DELETE /identity/v3/projects/6d109bcd9117440cb8930c9921ef70f4 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:08.517493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e005b3-d625-440a-b1d6-027a20b99a29 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.517493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e005b3-d625-440a-b1d6-027a20b99a29 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.517493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e005b3-d625-440a-b1d6-027a20b99a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.569901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-62e005b3-d625-440a-b1d6-027a20b99a29 None None] MFA Rules not processed for user `4000d0dd1cff46f79de3425acf536019`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:08.571196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-62e005b3-d625-440a-b1d6-027a20b99a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.589445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c210ea03-cf07-491b-bec5-8d61cc530bb7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.595698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.596597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.596863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.597183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] PATH_INFO: `/v3/projects/e4daaa6b1d0444d9a9fead265985d3c4/users/bcc25d76cb6c4dae91aac9f198babc7b/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.620505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4daaa6b1d0444d9a9fead265985d3c4, user_id=bcc25d76cb6c4dae91aac9f198babc7b, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.626879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.643324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 998/1996] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:08 2022] PUT /identity/v3/projects/e4daaa6b1d0444d9a9fead265985d3c4/users/bcc25d76cb6c4dae91aac9f198babc7b/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:08.644333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.661077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.692501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 999/1997] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:08.693934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.695992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.696294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.748961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] MFA Rules not processed for user `bcc25d76cb6c4dae91aac9f198babc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:08.749777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.774525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bd935c-2d25-47e8-8a1d-346041e5c9d4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.787830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.788713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.788990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.789257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] PATH_INFO: `/v3/users/d4951590a9c2461db298c7873d53dcaf` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.794208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4951590a9c2461db298c7873d53dcaf)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.796271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.865261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1000/1998] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:08.865261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.865261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.870742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4951590a9c2461db298c7873d53dcaf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.880632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4951590a9c2461db298c7873d53dcaf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.881706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8aa85-050d-40ee-812a-8446f20897b0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:08.887035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:08.887815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:08.888084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:08.888362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:08.889367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:08.892119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:08.895672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4951590a9c2461db298c7873d53dcaf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.896431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4951590a9c2461db298c7873d53dcaf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.908275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4951590a9c2461db298c7873d53dcaf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:08.915764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 999/1999] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:08 2022] DELETE /identity/v3/users/d4951590a9c2461db298c7873d53dcaf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:08.919634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.921189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:08.923326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1001/2000] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:08 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:08.927689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:08.930038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.019628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98325f88-8643-4473-8d64-a57be14ece3b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.049347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df8fb0-cf8a-40c6-b06f-24ce7cb08bdd admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.055922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.056972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.057555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.057840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.058901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.061984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.084018 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.085034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.085453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.085838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.088020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.096902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1002/2001] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:08 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:09.100734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.121494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b13216-06b4-4dff-a53f-c8f21c1975f3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.135516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.136208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.136488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.136762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.137499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.139109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.151521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1003/2002] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:09.157112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.188779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74572335-03e4-44e7-aed8-0aa4d016b811 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.190543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.192440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.203865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.204336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1000/2003] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:09.223009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.226346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.226840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] PATH_INFO: `/v3/projects/d4188b0fb06940e68089c2444e4fdc39/users/b5b13ecd9efe48a88a7b18b3bb8df24f/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.261260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.263083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.276921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4188b0fb06940e68089c2444e4fdc39, user_id=b5b13ecd9efe48a88a7b18b3bb8df24f, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.280030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.285383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4264673-614b-4790-aaa6-8bd6c7bf7247 service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.293676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.295883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.297364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.298608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] PATH_INFO: `/v3/users/bcc25d76cb6c4dae91aac9f198babc7b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.302622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc25d76cb6c4dae91aac9f198babc7b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.306673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.331738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1004/2004] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:09 2022] PUT /identity/v3/projects/d4188b0fb06940e68089c2444e4fdc39/users/b5b13ecd9efe48a88a7b18b3bb8df24f/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:09.336038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.342167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.412766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc25d76cb6c4dae91aac9f198babc7b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.422757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b53e8e-abcd-46fc-b302-4971712e6821 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.427700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.428582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.428866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.429141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] PATH_INFO: `/v3/projects/101dda93d64549f1b6ab43583b18cc39` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.430353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=101dda93d64549f1b6ab43583b18cc39)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.431277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc25d76cb6c4dae91aac9f198babc7b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.432388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.462936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc25d76cb6c4dae91aac9f198babc7b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.463371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc25d76cb6c4dae91aac9f198babc7b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.481228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc25d76cb6c4dae91aac9f198babc7b'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.490196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101dda93d64549f1b6ab43583b18cc39', 'request_id': 'req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.491919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1001/2005] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:09 2022] DELETE /identity/v3/users/bcc25d76cb6c4dae91aac9f198babc7b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:09.493079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.499106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101dda93d64549f1b6ab43583b18cc39', 'request_id': 'req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.500831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.507189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101dda93d64549f1b6ab43583b18cc39', 'request_id': 'req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.542751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] The token cache is being invalidate because project 101dda93d64549f1b6ab43583b18cc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:09.543200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.544605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-732cb15d-e5b2-43f4-b4ba-3aa1eda1e5a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:09.550915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1005/2006] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:09 2022] DELETE /identity/v3/projects/101dda93d64549f1b6ab43583b18cc39 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:09.553617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee62c4b-e9c7-4e54-838e-34df085ae6bf None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.556143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee62c4b-e9c7-4e54-838e-34df085ae6bf None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.557086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee62c4b-e9c7-4e54-838e-34df085ae6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.605909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-aee62c4b-e9c7-4e54-838e-34df085ae6bf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:09.608459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-aee62c4b-e9c7-4e54-838e-34df085ae6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.668019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d02c02-2f80-4982-990f-8e9914193928 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.679339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.680060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.680344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.680622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.681467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.683101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c617752-2873-4885-9b29-4d2bbaaf4cac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.710330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1002/2007] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:09.711796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.712180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.712349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.773196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:09.774442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.784381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1003/2008] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:09.785580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.787297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.799462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1006/2009] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:09.803231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.805603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830641c3-a55e-4d52-8b92-246822507ea6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:09.805973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.806766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.814297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:09.815299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:09.815683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:09.816741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] PATH_INFO: `/v3/projects/d4188b0fb06940e68089c2444e4fdc39/users/b5b13ecd9efe48a88a7b18b3bb8df24f/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:09.823797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4188b0fb06940e68089c2444e4fdc39, user_id=b5b13ecd9efe48a88a7b18b3bb8df24f, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:09.837224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:09.839483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.841172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:09.849603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1007/2010] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:09.852291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.855597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:09.889541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1004/2011] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:09 2022] PUT /identity/v3/projects/d4188b0fb06940e68089c2444e4fdc39/users/b5b13ecd9efe48a88a7b18b3bb8df24f/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:09.890538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:09.940750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efc0e8-00c6-4724-811f-ae5085cfd6d9 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.033387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11338797-ffa5-4ac9-8176-a661c88410d8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.040527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.041275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.041553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.041827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.042619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:10.042970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.044900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8394a-19a3-424d-9494-a3a1365fce8f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.056484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.057302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.057609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.057906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.062297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1005/2012] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:10.064315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.065159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.065658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.077243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.078910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.090083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1008/2013] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:10.090904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.102413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685501e-b642-4fe4-9e75-867553b688b7 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.107100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] MFA Rules not processed for user `b5b13ecd9efe48a88a7b18b3bb8df24f`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:10.108756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.108986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.109517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.110081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.110391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.111178 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.113973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.152168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1009/2014] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:10.158049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.245447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1006/2015] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:10.260511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.264781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.361904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176cb53-95aa-46bf-8652-5734e04db69b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.370153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.370849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.371127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.371421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.372527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.374733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.415326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1010/2016] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:10.418899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.424493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541d045-d732-46fd-9c87-a21c4c0c4beb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.434036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b83f-e6c1-4fd7-8aa6-b7f1e64cdf5d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.440478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.441551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.441989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.442406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.443406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.445337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.462405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1011/2017] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:10.465688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.481765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83caf77-4c35-43bc-9718-4925d7b1a248 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.497684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.498395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.498672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.498943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.500186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.501879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.514226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1012/2018] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:10.518057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.521055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.521741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.522020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.522291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.529633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653b583-0470-4f1e-bb2b-d5f973f0c7d8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.542193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.543108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.543409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.543685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] PATH_INFO: `/v3/projects/89b3aabc127047a8b60567ae30178359/users/3bc0b9e2834842f0a4c6fc1c720b888f/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.567247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b3aabc127047a8b60567ae30178359, user_id=3bc0b9e2834842f0a4c6fc1c720b888f, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.571199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1086e7-af90-4c74-8243-5037324ce0c0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.596159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1013/2019] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:10 2022] PUT /identity/v3/projects/89b3aabc127047a8b60567ae30178359/users/3bc0b9e2834842f0a4c6fc1c720b888f/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:10.608129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.608729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.609373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.643758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] MFA Rules not processed for user `3bc0b9e2834842f0a4c6fc1c720b888f`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:10.645514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.646581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.648568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.662915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1007/2020] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:10.721675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.723591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.735986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265a38-2c27-42c7-b476-23907c5821cb service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.754043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1014/2021] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:10.758089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.849806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.850480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.850760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.851028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.853075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.912047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50147561-2257-4279-bef4-e873cb6f3086 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.925111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.926547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.927528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.928320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.928988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.928988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.930063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.932005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:10.937288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1008/2022] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:10.938309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:10.939733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:10.958178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3d753-4e9d-461e-a81f-46b3499a411e service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:10.964544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:10.965592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:10.966025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:10.966434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] PATH_INFO: `/v3/projects/e4daaa6b1d0444d9a9fead265985d3c4` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:10.968125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4daaa6b1d0444d9a9fead265985d3c4)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:10.970299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.002142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1015/2023] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:10 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:11.005913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.077902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4daaa6b1d0444d9a9fead265985d3c4', 'request_id': 'req-426668f1-46d7-4b5e-8f7a-24ba0f932564'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:11.093107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4daaa6b1d0444d9a9fead265985d3c4', 'request_id': 'req-426668f1-46d7-4b5e-8f7a-24ba0f932564'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:11.101894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4daaa6b1d0444d9a9fead265985d3c4', 'request_id': 'req-426668f1-46d7-4b5e-8f7a-24ba0f932564'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:11.103713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e556a-f9b8-4f74-8d99-282b75027ff7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.121630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] The token cache is being invalidate because project e4daaa6b1d0444d9a9fead265985d3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:11.121930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:11.122736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-426668f1-46d7-4b5e-8f7a-24ba0f932564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:11.124574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1009/2024] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:10 2022] DELETE /identity/v3/projects/e4daaa6b1d0444d9a9fead265985d3c4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:11.130073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6fd1-4e15-43e7-ae12-b8c444bf353b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.130367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6fd1-4e15-43e7-ae12-b8c444bf353b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.130645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa6fd1-4e15-43e7-ae12-b8c444bf353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.152267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-33aa6fd1-4e15-43e7-ae12-b8c444bf353b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:11.153755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-33aa6fd1-4e15-43e7-ae12-b8c444bf353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.180567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.181273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.181554 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.181830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.183042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.185505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.213559 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1016/2025] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:11.217451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.219318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.231477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb27b8-1f92-4c83-8a63-565b796e28ea admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.237438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.238177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.238497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.238775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.239790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1010/2026] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:11.247629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.248143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.249114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.258670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.260899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.276046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1017/2027] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:11.277024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.278595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:11.280676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.287852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64595da6-43aa-4e45-aca2-aae84ba6efc4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.292946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.293724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1011/2028] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:11.295633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.296196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.299299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.300248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] PATH_INFO: `/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb/users/b126c4c4c3b944709938da2b7fce7e25/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.314643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f2d04-6c68-4bb3-b250-5267825e06cb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.321593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c257a458bcd42dbbb1ffd499fe2c6cb, user_id=b126c4c4c3b944709938da2b7fce7e25, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.322155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.322976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.323260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.323577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.324313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:11.324670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.325784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.326617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.342279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1012/2029] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:11.347052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.350825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1018/2030] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:11 2022] PUT /identity/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb/users/b126c4c4c3b944709938da2b7fce7e25/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:11.355015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.373340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdea70-cfa6-4523-b790-277209df217c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.466078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af1e088-543c-4b5f-874a-8ecb3095f750 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.478790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.479538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.479778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.480056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.481143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.482385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.501432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1019/2031] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:11.502370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.520095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.520775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.521055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.521326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.522026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.523981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.525680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb911b-e9fa-4c3e-b22e-38724158c0f7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.537744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.538842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.539125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.539419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] PATH_INFO: `/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb/users/b126c4c4c3b944709938da2b7fce7e25/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.544195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c257a458bcd42dbbb1ffd499fe2c6cb, user_id=b126c4c4c3b944709938da2b7fce7e25, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.547325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076bb59-fb61-438e-be90-3c0f46e62f76 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.580655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1020/2032] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:11 2022] PUT /identity/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb/users/b126c4c4c3b944709938da2b7fce7e25/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:11.586928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.587167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.589032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.593741 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1013/2033] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/projects => generated 373 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:11.595125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.640302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] MFA Rules not processed for user `b126c4c4c3b944709938da2b7fce7e25`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:11.641645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.681313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bcf4a-ac68-4664-ba6a-f80cdbf01571 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.695460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.696643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.697167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.697536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.699071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.702285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.725508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1021/2034] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:11.737779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.738644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1014/2035] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:11.740306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.742131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.750895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f4fcb-a4d0-4238-8fd4-6423bdae7012 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.757444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.758273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.758618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.758966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.760234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.762844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.778865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1022/2036] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:11.781741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.793415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ada179-9b33-421b-8005-7d1aa4ddc7d4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.798370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.799046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.799529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.799807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.800541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.802278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.819241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1023/2037] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:11.820294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.832317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfdc762-6139-4cd5-a976-39965483b324 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.838129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.840158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.840508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.841139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] PATH_INFO: `/v3/projects/0d5e29b8ac49423f9b0ce4eeb03e6be5/users/81ea59cb5330499189962477437b151c/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.847589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437dcb5-4a82-432c-9891-0ec8846e2752 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:11.852093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:11.852768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.853145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.853510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.857218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5e29b8ac49423f9b0ce4eeb03e6be5, user_id=81ea59cb5330499189962477437b151c, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.860000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58947689-fb54-487c-b952-01bd561c67df admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.865743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:11.867288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:11.885480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1024/2038] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:11 2022] PUT /identity/v3/projects/0d5e29b8ac49423f9b0ce4eeb03e6be5/users/81ea59cb5330499189962477437b151c/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:11.890339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:11.890626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:11.890951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:11.897194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1015/2039] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:11.910170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:11.911939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:11.982655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1025/2040] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:11.992609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:11.993976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:12.051976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c42ef9-8ac4-4589-8c95-b3effb4f4d24 service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.111846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.112452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.112751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.113048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.122988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.124622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.137121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1016/2041] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:12.233444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:12.310984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af4ebe-cba8-4e00-8ece-f298c744f869 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.317409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b126c4c4c3b944709938da2b7fce7e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.319023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.319335 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.319650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.320452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:12.320763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.322386 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.348302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1026/2042] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:12.349536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:12.360909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8992bb0-b9cd-4865-b9e4-6299bf9b6673 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.367111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b126c4c4c3b944709938da2b7fce7e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.367780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.368218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.368516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.369575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.371122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.402405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1017/2043] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:12 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:12.404004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:12.414744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca7527-2a3d-4d02-bd43-6dcb46359ede tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.497610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b126c4c4c3b944709938da2b7fce7e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.498552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.499072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.499588 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.500590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:12.500952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.502846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.517042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1027/2044] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:12.570973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:12.588853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e32a7-7841-4ce7-80fc-52f720cd3e6d tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:12.603578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b126c4c4c3b944709938da2b7fce7e25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:12.605866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:12.606151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:12.606428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] PATH_INFO: `/v3/projects/04b05205959a4608b5df79274b62af7e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:12.610068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorizing `identity:delete_project(project_id=04b05205959a4608b5df79274b62af7e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:12.612930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:12.735241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b05205959a4608b5df79274b62af7e', 'request_id': 'req-97a11530-c078-45b4-b69b-15fbfb1b5abf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:12.759845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b05205959a4608b5df79274b62af7e', 'request_id': 'req-97a11530-c078-45b4-b69b-15fbfb1b5abf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:12.772533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b05205959a4608b5df79274b62af7e', 'request_id': 'req-97a11530-c078-45b4-b69b-15fbfb1b5abf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:12.824080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] The token cache is being invalidate because project 04b05205959a4608b5df79274b62af7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:12.824700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:12.827423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-97a11530-c078-45b4-b69b-15fbfb1b5abf tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:12.829539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1018/2045] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:12 2022] DELETE /identity/v3/projects/04b05205959a4608b5df79274b62af7e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:13.257824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:13.259811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:13.383589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ea23f-ad23-4700-ae3f-099c61745db1 tempest-VolumeQuotaClassesTest-1515326460 tempest-VolumeQuotaClassesTest-1515326460-project-admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:13.459486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:13.460388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:13.460667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:13.460941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] PATH_INFO: `/v3/users/3bc0b9e2834842f0a4c6fc1c720b888f` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:13.462516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc0b9e2834842f0a4c6fc1c720b888f)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:13.465040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:13.548131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc0b9e2834842f0a4c6fc1c720b888f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:13.561202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc0b9e2834842f0a4c6fc1c720b888f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:13.569739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc0b9e2834842f0a4c6fc1c720b888f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:13.570762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc0b9e2834842f0a4c6fc1c720b888f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:13.583796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc0b9e2834842f0a4c6fc1c720b888f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:13.593345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1028/2046] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:13 2022] DELETE /identity/v3/users/3bc0b9e2834842f0a4c6fc1c720b888f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:13.599627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:13.599627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:13.599627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:13.621147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:13.623047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:13.705711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1019/2047] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:13.723472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:13.725043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:13.809206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d60d-ad3c-4a47-93bb-677edff70dcb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:13.814730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:13.815533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:13.816022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:13.816165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:13.829313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:13.832924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb4522-0540-43c4-a73b-7270c637ccb8 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:13.847510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1029/2048] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:14.463143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:14.465455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:14.482943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d78eed-195c-4922-9c3f-71c19e1091bd None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:14.489466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:14.490439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:14.490716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:14.490982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] PATH_INFO: `/v3/users/acc3647000404a3a937c4d3ab1b1e0e8` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:14.492640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc3647000404a3a937c4d3ab1b1e0e8)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:14.494684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:14.555931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc3647000404a3a937c4d3ab1b1e0e8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.564041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc3647000404a3a937c4d3ab1b1e0e8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.576731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc3647000404a3a937c4d3ab1b1e0e8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.577561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc3647000404a3a937c4d3ab1b1e0e8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.588643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc3647000404a3a937c4d3ab1b1e0e8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.598841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1020/2049] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:14 2022] DELETE /identity/v3/users/acc3647000404a3a937c4d3ab1b1e0e8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:14.600603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:14.601159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:14.601159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:14.622004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:14.623509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:14.672267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:14.674673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:14.714390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1030/2050] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:14.772464 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:14.774352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:14.789373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120329b-7407-4bd8-a999-316703eb9b6c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:14.807117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:14.808193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:14.808477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:14.808752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] PATH_INFO: `/v3/projects/89b3aabc127047a8b60567ae30178359` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:14.813207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b3aabc127047a8b60567ae30178359)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:14.819481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:14.853874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f84638-3e3d-4a5e-84fb-962b65132646 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:14.864683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:14.866088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:14.866632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:14.867108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:14.882753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b3aabc127047a8b60567ae30178359', 'request_id': 'req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.890233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b3aabc127047a8b60567ae30178359', 'request_id': 'req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.891792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:14.903333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:14.904813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b3aabc127047a8b60567ae30178359', 'request_id': 'req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.922136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] The token cache is being invalidate because project 89b3aabc127047a8b60567ae30178359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:14.922591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.923446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:14.925504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1021/2051] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:14 2022] DELETE /identity/v3/projects/89b3aabc127047a8b60567ae30178359 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:14.929644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:14.932058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:14.934869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1031/2052] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:15.026374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d0c75-5107-41c0-8f77-db7a7b81ac6c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:15.046727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:15.047843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.048215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.048579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] PATH_INFO: `/v3/users/b126c4c4c3b944709938da2b7fce7e25` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.050001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b126c4c4c3b944709938da2b7fce7e25)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:15.052109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:15.125301 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b126c4c4c3b944709938da2b7fce7e25'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.134419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b126c4c4c3b944709938da2b7fce7e25'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.148267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b126c4c4c3b944709938da2b7fce7e25'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.150082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b126c4c4c3b944709938da2b7fce7e25'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.169745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9910cb66-ef00-4ce1-a098-de2098766bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b126c4c4c3b944709938da2b7fce7e25'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.183425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1022/2053] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:14 2022] DELETE /identity/v3/users/b126c4c4c3b944709938da2b7fce7e25 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:15.566052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:15.581820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ca210-e08a-4875-9f81-1be26650881b service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:15.669124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:15.671292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.671597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.671899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] PATH_INFO: `/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.676522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c257a458bcd42dbbb1ffd499fe2c6cb)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:15.682049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:15.770086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'request_id': 'req-24273144-6bd4-4b26-a6ac-9f2d28747a74'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.793244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'request_id': 'req-24273144-6bd4-4b26-a6ac-9f2d28747a74'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.802087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c257a458bcd42dbbb1ffd499fe2c6cb', 'request_id': 'req-24273144-6bd4-4b26-a6ac-9f2d28747a74'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.818505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] The token cache is being invalidate because project 3c257a458bcd42dbbb1ffd499fe2c6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:15.819070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.821702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-24273144-6bd4-4b26-a6ac-9f2d28747a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:15.824918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1032/2054] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:15 2022] DELETE /identity/v3/projects/3c257a458bcd42dbbb1ffd499fe2c6cb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:15.829627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.830369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.830501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.856753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:15.858048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:15.942674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1023/2055] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:15.950210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:15.950565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:15.950842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:15.981931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:15.983139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:15.996216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:15.996846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1033/2056] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:16.006437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9554a11-c39e-4ef8-8104-c4ec4b622efb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.011155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.011908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.012189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.012463 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.013201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:16.013504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.015247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.028223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1024/2057] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:16.032875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.042750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a0207-a96c-452f-9066-075c88e3a12c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.064067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.071214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.071594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.072595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.073362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.075418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.116385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1034/2058] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:16 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:16.117846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.132248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85cc48-f2fc-44d2-ae44-bfd097791fac admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.169913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.171702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:16.210245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.210928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.211204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.211499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.212193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.214095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.269894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1025/2059] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:16 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:16.271025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.279620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35fc2-ce49-431f-9543-fbb5d6231bd2 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.282133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7c327-3dfb-4f87-9439-4b644942065c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.294651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.296018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.296154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.296250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.296250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] PATH_INFO: `/v3/projects/df1dc421248b47bb8192bf7142e9be75` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.296758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.297089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.297909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1dc421248b47bb8192bf7142e9be75)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.298562 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.299311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.300141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.307927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.335847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1026/2060] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:16.340025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.352306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc72613-b0a0-4d48-95d8-80ee6b49ff90 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.358570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.359113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.359972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.360738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.361489 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.363216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.383186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1027/2061] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:16.384446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.391018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1dc421248b47bb8192bf7142e9be75', 'request_id': 'req-9eacc21d-aa22-4d05-9497-35ca0220529d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.395995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105ea8a-ce69-4e87-af14-3ad4c3a45016 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.399814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1dc421248b47bb8192bf7142e9be75', 'request_id': 'req-9eacc21d-aa22-4d05-9497-35ca0220529d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.408680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1dc421248b47bb8192bf7142e9be75', 'request_id': 'req-9eacc21d-aa22-4d05-9497-35ca0220529d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.428106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] The token cache is being invalidate because project df1dc421248b47bb8192bf7142e9be75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:16.428535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.429847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.432606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1035/2062] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:16 2022] DELETE /identity/v3/projects/df1dc421248b47bb8192bf7142e9be75 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:16.436435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.438506 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:16.504573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.506158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.507295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.507744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] PATH_INFO: `/v3/projects/13afb5cfcb9b4fec919dc50083e9437f/users/507afe6ea8eb428b891099676e722f7e/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.514513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc21d-aa22-4d05-9497-35ca0220529d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.523251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.525233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.525845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.526321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] PATH_INFO: `/v3/users/4000d0dd1cff46f79de3425acf536019` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.528214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4000d0dd1cff46f79de3425acf536019)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.531061 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.532119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13afb5cfcb9b4fec919dc50083e9437f, user_id=507afe6ea8eb428b891099676e722f7e, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.534978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf895df-0420-4add-adc9-650bb771f2d4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.562158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1028/2063] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:16 2022] PUT /identity/v3/projects/13afb5cfcb9b4fec919dc50083e9437f/users/507afe6ea8eb428b891099676e722f7e/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:16.579528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.580629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.581532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.614225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4000d0dd1cff46f79de3425acf536019'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.629085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] MFA Rules not processed for user `507afe6ea8eb428b891099676e722f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:16.630397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:16.638325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4000d0dd1cff46f79de3425acf536019'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.648597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4000d0dd1cff46f79de3425acf536019'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.649592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4000d0dd1cff46f79de3425acf536019'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.660366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4000d0dd1cff46f79de3425acf536019'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:16.677604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1036/2064] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:16 2022] DELETE /identity/v3/users/4000d0dd1cff46f79de3425acf536019 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:16.772417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1029/2065] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:16.785558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:16.787000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:16.873820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c793-1466-43e5-96cc-da980c71f5fd admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:16.878215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:16.879114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:16.879513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:16.879889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:16.985084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:16.986547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:16.999684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1037/2066] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:17.020723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:17.022323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.192697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75e8ed-b499-4d61-befe-f67212e12be9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:17.249545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:17.256227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.330720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:17.332706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.333025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.333252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] PATH_INFO: `/v3/users/507afe6ea8eb428b891099676e722f7e` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.334501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507afe6ea8eb428b891099676e722f7e)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:17.336768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:17.372796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8a73-46eb-45eb-83bd-52ce369863b8 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:17.380816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:17.382500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.382720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.382995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] PATH_INFO: `/v3/projects/620bc08114f648518fb6c17e6ddda5a5` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.384707 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=620bc08114f648518fb6c17e6ddda5a5)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:17.387803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:17.406107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507afe6ea8eb428b891099676e722f7e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.417328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507afe6ea8eb428b891099676e722f7e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.445193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507afe6ea8eb428b891099676e722f7e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.446175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507afe6ea8eb428b891099676e722f7e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.456055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-55eac711-ef53-4ac8-9106-524b036289f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507afe6ea8eb428b891099676e722f7e'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.474189 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1030/2067] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:17 2022] DELETE /identity/v3/users/507afe6ea8eb428b891099676e722f7e => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:17.478379 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.478673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.479010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.480252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '620bc08114f648518fb6c17e6ddda5a5', 'request_id': 'req-8e283efb-260c-42c7-b893-0d0a3dd13180'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.490542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '620bc08114f648518fb6c17e6ddda5a5', 'request_id': 'req-8e283efb-260c-42c7-b893-0d0a3dd13180'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.505047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '620bc08114f648518fb6c17e6ddda5a5', 'request_id': 'req-8e283efb-260c-42c7-b893-0d0a3dd13180'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.511676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:17.512902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.528279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] The token cache is being invalidate because project 620bc08114f648518fb6c17e6ddda5a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:17.528587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.529872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.535999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1038/2068] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:17 2022] DELETE /identity/v3/projects/620bc08114f648518fb6c17e6ddda5a5 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:17.536945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:17.538481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.619622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1031/2069] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:17.627184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e283efb-260c-42c7-b893-0d0a3dd13180 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:17.631701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:17.633082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:17.634377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:17.636215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.636652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.637075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] PATH_INFO: `/v3/users/b5b13ecd9efe48a88a7b18b3bb8df24f` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.640921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b13ecd9efe48a88a7b18b3bb8df24f)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:17.642873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:17.720760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cabcc8-8f80-4703-b5b6-4b01b0b9f10e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:17.722097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b13ecd9efe48a88a7b18b3bb8df24f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.725033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:17.725976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:17.726263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:17.726542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:17.744858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:17.746658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:17.752370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b13ecd9efe48a88a7b18b3bb8df24f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.759526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1032/2070] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:17.767154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b13ecd9efe48a88a7b18b3bb8df24f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.768932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b13ecd9efe48a88a7b18b3bb8df24f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.780955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58c7318f-0408-41b2-a71e-847a06a0d844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b13ecd9efe48a88a7b18b3bb8df24f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:17.792323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1039/2071] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:17 2022] DELETE /identity/v3/users/b5b13ecd9efe48a88a7b18b3bb8df24f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:18.543425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:18.544870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:18.558315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9392e-6f69-42f8-810a-728ca5d9ac61 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:18.621294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:18.621946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:18.622225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:18.622506 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] PATH_INFO: `/v3/projects/13afb5cfcb9b4fec919dc50083e9437f` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:18.623761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13afb5cfcb9b4fec919dc50083e9437f)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:18.625970 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:18.709613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13afb5cfcb9b4fec919dc50083e9437f', 'request_id': 'req-611f48cd-a70b-4664-a970-50a34003cb60'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:18.722951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13afb5cfcb9b4fec919dc50083e9437f', 'request_id': 'req-611f48cd-a70b-4664-a970-50a34003cb60'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:18.735667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13afb5cfcb9b4fec919dc50083e9437f', 'request_id': 'req-611f48cd-a70b-4664-a970-50a34003cb60'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:18.754455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] The token cache is being invalidate because project 13afb5cfcb9b4fec919dc50083e9437f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:18.754805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:18.755670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-611f48cd-a70b-4664-a970-50a34003cb60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:18.759583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1033/2072] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:18 2022] DELETE /identity/v3/projects/13afb5cfcb9b4fec919dc50083e9437f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:18.765602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:18.766087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:18.766369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:18.787646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:18.790036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:18.884898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1040/2073] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:18.892669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:18.892957 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:18.893261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:18.917182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:18.918739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:18.936619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:18.938023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00f3d7-5508-4680-9a2b-dbfe36ab7329 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:18.940938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:18.959311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:18.959652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1034/2074] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:18.966370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:18.968350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:18.968678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] PATH_INFO: `/v3/projects/d4188b0fb06940e68089c2444e4fdc39` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:18.969732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:18.973012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4188b0fb06940e68089c2444e4fdc39)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:18.979836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:18.992643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562424d5-f04e-4bf8-b56c-fad4e00d9d21 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.007765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.008477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.008834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.009183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.010004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:19.010381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.014040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.042516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1035/2075] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:19.047234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.070092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee26c00-6b4c-452a-a4a5-d4527701d379 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.084214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.084897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.085178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.085452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.086515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.094337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.133654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4188b0fb06940e68089c2444e4fdc39', 'request_id': 'req-916410e0-e80d-469f-bc59-6e0ae67e1706'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:19.155437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1036/2076] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:19.159534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.165014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4188b0fb06940e68089c2444e4fdc39', 'request_id': 'req-916410e0-e80d-469f-bc59-6e0ae67e1706'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:19.175316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4188b0fb06940e68089c2444e4fdc39', 'request_id': 'req-916410e0-e80d-469f-bc59-6e0ae67e1706'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:19.193052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] The token cache is being invalidate because project d4188b0fb06940e68089c2444e4fdc39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:19.193592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:19.194460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-916410e0-e80d-469f-bc59-6e0ae67e1706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:19.198256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1041/2077] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:18 2022] DELETE /identity/v3/projects/d4188b0fb06940e68089c2444e4fdc39 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:19.205582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8557a-d5ca-4d53-b44c-c3a722053bb8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.206119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8557a-d5ca-4d53-b44c-c3a722053bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.206693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8557a-d5ca-4d53-b44c-c3a722053bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.255057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e9b8557a-d5ca-4d53-b44c-c3a722053bb8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:19.263307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e9b8557a-d5ca-4d53-b44c-c3a722053bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:19.297623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f2cb7-62f4-4ca1-938e-bb6f39e906fb admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.308019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.309673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.311364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.311675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.312468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.318833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.345659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1037/2078] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:19.349218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.352150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:19.364998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1042/2079] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:19.366840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.367116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.367434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.380488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae84f-cc34-445e-ab7f-d9959ad35e3a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.393066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:19.394579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:19.397116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.397809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.398071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.398342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.399667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.402787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.405569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1043/2080] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:19.409798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.419634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a113962-8b26-47a3-ad63-475851eef017 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.426727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1038/2081] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:19.431122 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.431418 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.431922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.432205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.432523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.433267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:19.433572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.435284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.452079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1044/2082] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:41:19.455622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44899cd8-3c35-432a-bb74-88288a4b9999 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.456745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.464791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.465474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.465752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.466020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.466905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23104b8-69a2-496d-8e92-1d16ce899d69 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.468468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.472241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.473271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.473271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.473450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.474135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.474236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.476089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.503782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1039/2083] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:19.508711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.535724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2caa56-a803-406a-b7a2-19bf726fe0a4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.538911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1045/2084] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:19.543261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.543351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.544784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.545341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.545341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] PATH_INFO: `/v3/projects/12b888fe615b4584acf7364af716b7b1/users/6f42ef31a8394831aa34cb1296033dba/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.572993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b888fe615b4584acf7364af716b7b1, user_id=6f42ef31a8394831aa34cb1296033dba, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.583191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a96645-3abe-4e60-88f7-582f5f9b2d91 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.601280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1040/2085] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:19 2022] PUT /identity/v3/projects/12b888fe615b4584acf7364af716b7b1/users/6f42ef31a8394831aa34cb1296033dba/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:19.622493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.622782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.623060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.650411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbbeb9-2b92-4c91-aaac-9f1d1687b35b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.693415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] MFA Rules not processed for user `6f42ef31a8394831aa34cb1296033dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:19.695244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:19.743029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.743759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.744040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.744313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.745008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.746954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.783762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1041/2086] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:19.798152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.799694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:19.806785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1046/2087] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:19 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:19.807964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.821803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e7148-727a-4782-8a15-e0f8b1711cc7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.828286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.828976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.829258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.829534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.830589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.832660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.864207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1047/2088] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:19.865912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.893858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9a148-108a-4aa2-bd77-c0714b1812f9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.908017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.908905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.909191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.909609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.910359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.912009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:19.942823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1048/2089] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:19.947190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:19.953288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93785d5-f54e-44a8-ac1d-0fc362b363d7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.970066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.970733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.971019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.971500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d91144-0031-4dcb-a973-8b906192d8d0 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:19.971620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.981988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:19.983449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:19.984819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:19.985556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:19.985866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] PATH_INFO: `/v3/projects/3cb1f22288e941568b835c67d375ad2d/users/7b4f03e21a8c4ec8900cca666902f198/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:19.986231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9ace2-b212-4cf7-b43a-646084d24c3d service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.006340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb1f22288e941568b835c67d375ad2d, user_id=7b4f03e21a8c4ec8900cca666902f198, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.008473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1042/2090] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:20.009047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c1cf-fa03-4b6f-882d-212cdf5098c0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.057759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1049/2091] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:19 2022] PUT /identity/v3/projects/3cb1f22288e941568b835c67d375ad2d/users/7b4f03e21a8c4ec8900cca666902f198/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:20.059289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.059787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.060221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.124610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.124610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.124610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.141931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] MFA Rules not processed for user `7b4f03e21a8c4ec8900cca666902f198`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:20.144959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:20.208866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] MFA Rules not processed for user `81ea59cb5330499189962477437b151c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:20.210262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:20.248573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1043/2092] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:20.263988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.265650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:20.310714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1050/2093] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:20.315734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.322774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:20.355914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78ed8-8db8-4067-a980-94cfd44b9bf5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.365457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.366216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.366709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.367052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.386145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.387931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.416811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1044/2094] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:20.468781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4829d69-b827-4a57-945b-3e5cfc017471 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.473829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.474884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.474884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.475093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.475766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.477663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.524943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1051/2095] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:20 2022] POST /identity/v3/projects => generated 371 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:20.528423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.541629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323ae70-75eb-4aa8-b659-699d57ec753d service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.612259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.613951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.614408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.614952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.616051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.618654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.646352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1045/2096] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:20 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:41:20.651769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.678819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31d626-556d-42ee-8f3d-8a9411f8c73e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.724311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.724962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.725287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.725561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.726338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.728038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.759699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1052/2097] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:20.760615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.773963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900e558-b597-49e1-af00-6977bd57126c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:20.788381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:20.789843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:20.790235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:20.790607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] PATH_INFO: `/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6/users/d35160242aac4e75a01b09a9f4173e0b/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:20.847998 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6828cf4f44fa8abce304bf3506cd6, user_id=d35160242aac4e75a01b09a9f4173e0b, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:20.857130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:20.883880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1046/2098] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:20 2022] PUT /identity/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6/users/d35160242aac4e75a01b09a9f4173e0b/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:20.887649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:20.899529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d6443-4167-42ff-9214-978e14433cb4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:21.036148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:21.037026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:21.039544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:21.040112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:21.040806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:21.044371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3c96-4b6d-4edf-952a-6f79570da5de admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:21.067569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1053/2099] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:21.073019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:21.083720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933472d-49ca-41bb-a150-9d0da8ab958b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:21.088556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:21.089510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:21.089790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:21.090109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] PATH_INFO: `/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6/users/d35160242aac4e75a01b09a9f4173e0b/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:21.096012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6828cf4f44fa8abce304bf3506cd6, user_id=d35160242aac4e75a01b09a9f4173e0b, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:21.098825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:21.109768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1047/2100] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:21 2022] PUT /identity/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6/users/d35160242aac4e75a01b09a9f4173e0b/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:41:27.105838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a186-b458-4ee6-8d60-2b23ccf60870 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:27.106692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a186-b458-4ee6-8d60-2b23ccf60870 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:27.107149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a186-b458-4ee6-8d60-2b23ccf60870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:27.134816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6f61a186-b458-4ee6-8d60-2b23ccf60870 None None] MFA Rules not processed for user `d35160242aac4e75a01b09a9f4173e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:27.136076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6f61a186-b458-4ee6-8d60-2b23ccf60870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:27.212733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1054/2101] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:27.224050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:27.226802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:27.306221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5504cff-c08b-44c7-990c-7004b5e92d39 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:27.311606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:27.312307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:27.312574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:27.312843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:27.390354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:27.392298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:27.402656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1048/2102] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:28.787974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a76ff-e40a-4e50-a681-bf9d11631560 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:28.788541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a76ff-e40a-4e50-a681-bf9d11631560 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:28.788541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a76ff-e40a-4e50-a681-bf9d11631560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:28.807151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f28a76ff-e40a-4e50-a681-bf9d11631560 None None] MFA Rules not processed for user `81ea59cb5330499189962477437b151c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:28.808409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f28a76ff-e40a-4e50-a681-bf9d11631560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:28.817688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1055/2103] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:33.521684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:33.584207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d8352c-23aa-4997-aa57-76581e98159e service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:33.589186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:33.590050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:33.590325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:33.590594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] PATH_INFO: `/v3/users/7b4f03e21a8c4ec8900cca666902f198` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:33.591809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b4f03e21a8c4ec8900cca666902f198)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:33.593805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:33.648083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b4f03e21a8c4ec8900cca666902f198'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:33.655241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b4f03e21a8c4ec8900cca666902f198'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:33.675713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b4f03e21a8c4ec8900cca666902f198'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:33.676473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b4f03e21a8c4ec8900cca666902f198'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:33.686102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b4f03e21a8c4ec8900cca666902f198'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:33.693225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1049/2104] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:33 2022] DELETE /identity/v3/users/7b4f03e21a8c4ec8900cca666902f198 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:33.697668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:33.698184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:33.698266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:33.716434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:33.717633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:33.783176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1056/2105] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:33.793466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:33.795803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:33.867227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259582-4b9c-4e78-918e-20988cb8a70f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:33.871200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:33.871895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:33.872178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:33.872449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:33.881875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:33.883395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f58a7a-9d79-4813-836a-5a32a1691581 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:33.893354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1050/2106] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:34.226298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.227830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:34.241380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cced8c-a003-4f14-8acd-25d7ab070b00 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.264173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.265534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.265995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.266427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] PATH_INFO: `/v3/projects/3cb1f22288e941568b835c67d375ad2d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.268084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb1f22288e941568b835c67d375ad2d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.271048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.347036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb1f22288e941568b835c67d375ad2d', 'request_id': 'req-277d402f-0d3f-4fe1-a1b5-d0075699d575'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:34.353252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb1f22288e941568b835c67d375ad2d', 'request_id': 'req-277d402f-0d3f-4fe1-a1b5-d0075699d575'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:34.363750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb1f22288e941568b835c67d375ad2d', 'request_id': 'req-277d402f-0d3f-4fe1-a1b5-d0075699d575'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:34.393653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] The token cache is being invalidate because project 3cb1f22288e941568b835c67d375ad2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:34.394066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:34.395832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-277d402f-0d3f-4fe1-a1b5-d0075699d575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:34.398085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1057/2107] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:34 2022] DELETE /identity/v3/projects/3cb1f22288e941568b835c67d375ad2d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:34.403210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.403536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.403817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.438005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:34.439640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:34.543625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1051/2108] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:34.553254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.554016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.554500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.577890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:34.579608 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:34.590226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1058/2109] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:34.597672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.610871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98148191-1ebc-4268-9c70-57d5deaa8d78 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.615908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.616589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.616933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.617274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.618504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:34.618780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.620847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.640502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1052/2110] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:34.645905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.658053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7edfc03-e6c9-4d7f-8e84-3ed8c53b7c83 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.663911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.665257 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.666016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.666621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.667692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.670635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.721594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1059/2111] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:34 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:34.723151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.736328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccad440-47df-4c1c-ac83-e4d8d22d24ba admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.834191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.835006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.835288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.835597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.836534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.838518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.863981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1053/2112] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:34 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:34.865227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.875869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726ed14-96bc-4a99-970e-e238aeeb17d4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.882002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.882862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.883227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.883593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.884409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.886083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.897830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1060/2113] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:34.902069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.912329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec54a9-38e6-4f45-9ed2-80d2e4756aac admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.917824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.918565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.918844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.919142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.919979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.921658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220bf44-ed3f-4957-8e47-e8686c5b0458 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:34.934194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1054/2114] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:34.939119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:34.957349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac375ae8-4f5f-444e-ae61-62198958e4c0 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:34.966475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:34.967498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:34.967773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:34.968144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] PATH_INFO: `/v3/projects/92ab90f5a74549468110ed0afa290920/users/48671196fd864811bb26b19725d3f6e7/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:34.994920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ab90f5a74549468110ed0afa290920, user_id=48671196fd864811bb26b19725d3f6e7, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:34.999960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:35.018209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1061/2115] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:34 2022] PUT /identity/v3/projects/92ab90f5a74549468110ed0afa290920/users/48671196fd864811bb26b19725d3f6e7/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:35.028834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:35.029113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:35.029409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:35.057853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] MFA Rules not processed for user `48671196fd864811bb26b19725d3f6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:35.059713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:35.135810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1055/2116] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:35.148298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:35.151536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:35.215785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10b252-8ef4-4b26-a5b8-2ae97eac8dd3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:35.221112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:35.221763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:35.222042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:35.222322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:35.232357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:35.234259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:35.244687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1062/2117] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:38.965474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:38.967025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:39.043673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b4f7-670f-4561-b8ff-79dd6b6899d7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.048371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.049471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.049881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.050268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] PATH_INFO: `/v3/users/c7ebe69827a64b8b86a9665b884a189a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.051851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ebe69827a64b8b86a9665b884a189a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.053789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.099973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ebe69827a64b8b86a9665b884a189a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.106743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ebe69827a64b8b86a9665b884a189a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.118338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ebe69827a64b8b86a9665b884a189a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.118984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ebe69827a64b8b86a9665b884a189a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.127935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5763a5f0-7afe-4743-beaa-3a9abf95555c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ebe69827a64b8b86a9665b884a189a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.133871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1056/2118] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:38 2022] DELETE /identity/v3/users/c7ebe69827a64b8b86a9665b884a189a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:39.329603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.340836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde16d1f-7cfd-4f5c-924d-09bc3dac955a service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.400001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.400860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.401138 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.401412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] PATH_INFO: `/v3/projects/7b9fa6a05dcd47eb8fd05a41a757bc8a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.402631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9fa6a05dcd47eb8fd05a41a757bc8a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.404577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.455049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9fa6a05dcd47eb8fd05a41a757bc8a', 'request_id': 'req-bbb58aa8-1dcf-41f4-8de2-0a144411c719'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.460646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9fa6a05dcd47eb8fd05a41a757bc8a', 'request_id': 'req-bbb58aa8-1dcf-41f4-8de2-0a144411c719'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.466930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9fa6a05dcd47eb8fd05a41a757bc8a', 'request_id': 'req-bbb58aa8-1dcf-41f4-8de2-0a144411c719'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.481664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] The token cache is being invalidate because project 7b9fa6a05dcd47eb8fd05a41a757bc8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:39.481949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.482656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbb58aa8-1dcf-41f4-8de2-0a144411c719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:39.484303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1063/2119] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:39 2022] DELETE /identity/v3/projects/7b9fa6a05dcd47eb8fd05a41a757bc8a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:39.489359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.489652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.489914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.508454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:39.509688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:39.569979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1057/2120] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:39.579765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.580053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.580332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.600119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:39.601354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:39.609227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1064/2121] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:39.617647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.628166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b12e0-9bc1-4c00-83c9-65bed0279471 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.633975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.634631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.634905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.635179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.635953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:39.636254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.637858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.649980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1058/2122] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:41:39.654547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.664338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbeef3-afcd-4d05-9122-eab21936915a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.670243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.670934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.671183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.671455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.672139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.674030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.708332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1065/2123] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:39 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:39.709615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.720492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ef449-c38e-45a8-a3ab-e55ab20ae9e1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.778856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.779606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.780020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.780306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.781140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.783288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.807228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1059/2124] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:39 2022] POST /identity/v3/users => generated 279 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:39.811528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.823833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d6414-ea9d-486a-b16d-5cf304ec8d7f admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.829603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.830324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.830542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.830865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.831599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.833190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.843825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1066/2125] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:39.848073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.858355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e093a1e1-f5df-456f-ae50-18e946107cab admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.863326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.864005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.864288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.864561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.865280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.866858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e693c4-27e6-4ff2-94db-e0d922c925ee admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.880333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1060/2126] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:39.882046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:39.897686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccad29-74f2-444b-a5a2-6df26253c949 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:39.902364 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:39.903255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.903717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.903997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] PATH_INFO: `/v3/projects/609c36b7955848e3be1d400cc8e5cce8/users/ee70c10fa86248499e93957538eedb03/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.918577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=609c36b7955848e3be1d400cc8e5cce8, user_id=ee70c10fa86248499e93957538eedb03, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:39.921323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:39.937280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1067/2127] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:39 2022] PUT /identity/v3/projects/609c36b7955848e3be1d400cc8e5cce8/users/ee70c10fa86248499e93957538eedb03/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:39.948541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:39.948888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:39.949088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:39.978866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] MFA Rules not processed for user `ee70c10fa86248499e93957538eedb03`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:39.980122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:40.046550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1061/2128] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:40.050979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.120327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90bf01-d2ef-4742-ac22-bfa5ad05f8ce admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.125079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.130100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.130100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.130100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.130100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.130100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.157883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1068/2129] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:40 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:40.161829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.172353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fc0e5-757f-444a-9b05-bd00d878c8f9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.232942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.233764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.234090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.234367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.235069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.237177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.258999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1062/2130] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:40 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:40.263121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.273412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182215d7-d7c7-457b-867a-1dc2eab0a292 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.278079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.278767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.279113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.279427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.280434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.282102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.293174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1069/2131] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:40.297676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.308163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92b564-4b54-4c25-8569-6f6f6c6072d0 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.313404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.314285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.314564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.314836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] PATH_INFO: `/v3/projects/ebe876d976f1489caaeca3c2e649336f/users/52df1220967246e3bfb140f504d43bc6/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.331205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe876d976f1489caaeca3c2e649336f, user_id=52df1220967246e3bfb140f504d43bc6, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.334130 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.349363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1063/2132] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:40 2022] PUT /identity/v3/projects/ebe876d976f1489caaeca3c2e649336f/users/52df1220967246e3bfb140f504d43bc6/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:40.353477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.363717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb01b1-67c5-4ddd-86f2-0f85757378e5 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.420401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.421474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.421904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.422413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.423841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.426614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1d283-ef70-493d-bb66-128096f6c0c4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.439878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1070/2133] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:40.445899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.457254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91781582-5a96-4541-b45f-e636655b96d2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.463990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.464864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.465142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.465412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] PATH_INFO: `/v3/projects/ebe876d976f1489caaeca3c2e649336f/users/52df1220967246e3bfb140f504d43bc6/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.468040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe876d976f1489caaeca3c2e649336f, user_id=52df1220967246e3bfb140f504d43bc6, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.470654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.481542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1064/2134] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:40 2022] PUT /identity/v3/projects/ebe876d976f1489caaeca3c2e649336f/users/52df1220967246e3bfb140f504d43bc6/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:40.491734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.492005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.492274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.524791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] MFA Rules not processed for user `52df1220967246e3bfb140f504d43bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:40.526005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:40.599363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1071/2135] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:41:40.611693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.613537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:40.677811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5117aa-dd17-4743-bd17-bec1d762a5ff admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.682556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.683245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.683548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.683894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.694077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.695732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c852e-bc37-4266-bcda-e1dec9068c66 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.705572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1065/2136] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:40.785813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:40.796982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d2300-9296-4f98-86e3-05cd662c9f77 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:40.800993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:40.801650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:40.801922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:40.802191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:40.861747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:40.863190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:40.872899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1072/2137] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:41:46.689361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab612f-0c00-4934-b443-8912cd22af1e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:46.689867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab612f-0c00-4934-b443-8912cd22af1e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:46.690083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab612f-0c00-4934-b443-8912cd22af1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:46.708804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ffab612f-0c00-4934-b443-8912cd22af1e None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:46.710072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ffab612f-0c00-4934-b443-8912cd22af1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:46.767641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1066/2138] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:46.817687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:46.819560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:46.892535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855cd288-4f9e-4316-a5a4-1d9e4000d62f service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:46.898242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:46.898902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:46.899183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:46.899487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:46.908347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:46.909957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:46.918270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1073/2139] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:41:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:41:47.425125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783b65-28cb-49ef-8b13-52aedb2a2db2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:47.425408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783b65-28cb-49ef-8b13-52aedb2a2db2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:47.425680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6783b65-28cb-49ef-8b13-52aedb2a2db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:47.443443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c6783b65-28cb-49ef-8b13-52aedb2a2db2 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:47.444690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c6783b65-28cb-49ef-8b13-52aedb2a2db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:47.454410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1067/2140] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:47.468302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:47.479254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524e30-f035-48d0-ada7-e1fda9e684d1 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:47.485298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:47.486082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:47.486358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:47.486657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:47.494745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:47.496381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:47.508823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1074/2141] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:41:47.707854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e312c4-8694-4a85-b3ca-a5438ae42952 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:47.708322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e312c4-8694-4a85-b3ca-a5438ae42952 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:47.708423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e312c4-8694-4a85-b3ca-a5438ae42952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:47.727111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-78e312c4-8694-4a85-b3ca-a5438ae42952 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:47.728332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-78e312c4-8694-4a85-b3ca-a5438ae42952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:47.735915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1068/2142] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:47.748118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:47.759358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56172be3-accb-4c14-a9fd-80bf99b62d53 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:47.765040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:47.765685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:47.765959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:47.766228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:47.774859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:47.776437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:47.784529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1075/2143] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:41:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:41:48.105898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:48.106179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:48.106448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:48.123884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:48.125097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:48.132622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1069/2144] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:48.144813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:48.154832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e21c6bb-02a1-4542-9dc7-6ed0e624c9a5 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:48.160365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:48.161203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:48.161483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:48.161763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:48.171094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:48.173126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e41abf-ab64-44f3-bbc7-33244d31a136 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:48.182639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1076/2145] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:41:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:41:54.444673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:54.446159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:54.513603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871084bd-1cdd-441c-b47b-8ecd147eed2c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:54.518392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:54.519256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:54.519568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:54.519841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] PATH_INFO: `/v3/users/00c54721eef24b2cb6266081c860120a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:54.521098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c54721eef24b2cb6266081c860120a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:54.523014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:54.569846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c54721eef24b2cb6266081c860120a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:54.576940 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c54721eef24b2cb6266081c860120a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:54.591929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c54721eef24b2cb6266081c860120a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:54.593858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c54721eef24b2cb6266081c860120a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:54.602521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c54721eef24b2cb6266081c860120a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:54.610775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1070/2146] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:41:54 2022] DELETE /identity/v3/users/00c54721eef24b2cb6266081c860120a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:54.615203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:54.615758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:54.615846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:54.634631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:54.635905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:54.694210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1077/2147] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:54.704935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:54.706806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:54.767133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eeef5e-6dbf-4e3a-a441-a961c9469f77 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:54.770882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:54.771560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:54.771836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:54.772111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:54.781227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:54.782661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c274295-842a-454b-b554-617d8527bc5e service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:54.792045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1071/2148] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:41:54.972241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:54.973759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:54.987980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2934d95-5f2e-448c-8b0c-8699835d6d1c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:54.993547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:54.994494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:54.994864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:54.995221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] PATH_INFO: `/v3/projects/1d302bed84434e1089efe44793d5cfa8` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:54.996576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d302bed84434e1089efe44793d5cfa8)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:54.998574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.055643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d302bed84434e1089efe44793d5cfa8', 'request_id': 'req-4403b1d7-a758-4e3e-adec-a11d55aa4374'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:55.061277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d302bed84434e1089efe44793d5cfa8', 'request_id': 'req-4403b1d7-a758-4e3e-adec-a11d55aa4374'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:55.067357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d302bed84434e1089efe44793d5cfa8', 'request_id': 'req-4403b1d7-a758-4e3e-adec-a11d55aa4374'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:55.081769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] The token cache is being invalidate because project 1d302bed84434e1089efe44793d5cfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:41:55.082056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:55.082665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4403b1d7-a758-4e3e-adec-a11d55aa4374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:41:55.084473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1078/2149] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:41:54 2022] DELETE /identity/v3/projects/1d302bed84434e1089efe44793d5cfa8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:55.089689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.089979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.090280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.107863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:55.109083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:55.172695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1072/2150] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:55.180471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.180747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.181019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.200223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:55.201333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:55.210158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1079/2151] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:55.214503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.225382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48905-60e5-4146-a1ca-6c7dd8f01c92 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.230637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.231281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.231595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.231867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.232663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:41:55.232946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.234568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.248779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1073/2152] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:41:55.253341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.263201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f0edd-7e3f-482b-be32-cd9ad15eb86a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.269337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.269977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.270250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.270516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.271196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.273132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.299644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1080/2153] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:41:55 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:55.303646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.314694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd44a6-ba00-4fc2-94dc-17c065b2eeac admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.383968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53217105-4062-4903-920f-db31d679e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.384640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217105-4062-4903-920f-db31d679e146 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.384918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217105-4062-4903-920f-db31d679e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.385193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53217105-4062-4903-920f-db31d679e146 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.385881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53217105-4062-4903-920f-db31d679e146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.387846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53217105-4062-4903-920f-db31d679e146 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.409934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1074/2154] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:41:55 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:41:55.413366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.423978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2492c-657b-43cf-bb26-ee1a46b9c93b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.428875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.429568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.429845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.430157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.430959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.432741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.444284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1081/2155] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:41:55.448521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53217105-4062-4903-920f-db31d679e146 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.459236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53217105-4062-4903-920f-db31d679e146 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.464411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.465053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.465329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.465603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.466327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.467988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eac3a-63ad-4acc-9253-2b461440e7fc admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.477984 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1075/2156] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:41:55.482001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.492829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa14d7a-b5bc-4b0e-93ea-47cb3ca0878a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.497855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.498729 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.499014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.499283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] PATH_INFO: `/v3/projects/9e8884a9c2ff4ab5bdc21c14ab7ddf13/users/40bf5f0d63664018952fe5ba80310d56/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.515179 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e8884a9c2ff4ab5bdc21c14ab7ddf13, user_id=40bf5f0d63664018952fe5ba80310d56, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.517893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.535416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1082/2157] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:41:55 2022] PUT /identity/v3/projects/9e8884a9c2ff4ab5bdc21c14ab7ddf13/users/40bf5f0d63664018952fe5ba80310d56/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:41:55.546535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.546825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.547100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.574702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] MFA Rules not processed for user `40bf5f0d63664018952fe5ba80310d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:41:55.576327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:55.650164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1076/2158] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:41:55.665952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:41:55.667701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:41:55.726484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472791c-f5d4-4e2e-a00b-1bb0fdfb04c8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:41:55.732499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:41:55.738033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:41:55.738033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:41:55.738033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:41:55.746635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:41:55.748175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fd6db-6574-466a-8440-3bb034fbeb15 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:41:55.764662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1083/2159] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:39.882514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:39.990914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc38bb8-b4da-478f-800c-9164a03e695d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:39.996107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:39.996989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:39.997267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:39.997538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] PATH_INFO: `/v3/users/40bf5f0d63664018952fe5ba80310d56` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:39.998717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bf5f0d63664018952fe5ba80310d56)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:40.000723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:40.063308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bf5f0d63664018952fe5ba80310d56'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.077857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bf5f0d63664018952fe5ba80310d56'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.085135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bf5f0d63664018952fe5ba80310d56'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.086473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bf5f0d63664018952fe5ba80310d56'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.102901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bf5f0d63664018952fe5ba80310d56'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.111989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1077/2160] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:39 2022] DELETE /identity/v3/users/40bf5f0d63664018952fe5ba80310d56 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:40.116347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:40.117489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:40.117790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:40.170663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:40.172170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:40.234419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1084/2161] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:40.248834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:40.250238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:40.363231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc313a8-0c91-4123-b905-2a592ece68b8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:40.366914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:40.368237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:40.368514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:40.369138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:40.380854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:40.382646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:40.394841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1078/2162] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:40.794028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:40.795563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:40.817089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf667e-f132-435d-8baa-a7ccae2ac2ec None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:40.833476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:40.834857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:40.837128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:40.837620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] PATH_INFO: `/v3/projects/9e8884a9c2ff4ab5bdc21c14ab7ddf13` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:40.840550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e8884a9c2ff4ab5bdc21c14ab7ddf13)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:40.843119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:40.882494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:40.884729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:40.900341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8baf49d-9af4-452d-92d4-f0bc9048895e service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:40.913369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e8884a9c2ff4ab5bdc21c14ab7ddf13', 'request_id': 'req-9c6e042a-2016-4bcc-9187-50cfaac825ef'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.921414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e8884a9c2ff4ab5bdc21c14ab7ddf13', 'request_id': 'req-9c6e042a-2016-4bcc-9187-50cfaac825ef'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.929194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e8884a9c2ff4ab5bdc21c14ab7ddf13', 'request_id': 'req-9c6e042a-2016-4bcc-9187-50cfaac825ef'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.951787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] The token cache is being invalidate because project 9e8884a9c2ff4ab5bdc21c14ab7ddf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:40.952389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.954093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9c6e042a-2016-4bcc-9187-50cfaac825ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:40.957114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1085/2163] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:40 2022] DELETE /identity/v3/projects/9e8884a9c2ff4ab5bdc21c14ab7ddf13 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:40.963923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:40.964316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:40.964654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:40.983276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:40.984522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:40.984981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:40.985341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] PATH_INFO: `/v3/users/ee70c10fa86248499e93957538eedb03` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:40.986727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee70c10fa86248499e93957538eedb03)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:40.989590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.048654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:41.050593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.061123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1086/2164] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:41.063084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.067848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee70c10fa86248499e93957538eedb03'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.068350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.077713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee70c10fa86248499e93957538eedb03'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.089509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e90f8d5-933e-4301-8cc3-29d037d9266c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.092695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee70c10fa86248499e93957538eedb03'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.093760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee70c10fa86248499e93957538eedb03'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.094303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.095882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.096123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.096658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] PATH_INFO: `/v3/users/48671196fd864811bb26b19725d3f6e7` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.098046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48671196fd864811bb26b19725d3f6e7)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.115830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4fbedd10-f61f-4621-b5a9-840dba810888 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee70c10fa86248499e93957538eedb03'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.116541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.145578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1079/2165] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:40 2022] DELETE /identity/v3/users/ee70c10fa86248499e93957538eedb03 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:41.147461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cffd02-59a8-4a90-9993-2addb9a4da95 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.147946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cffd02-59a8-4a90-9993-2addb9a4da95 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.148702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cffd02-59a8-4a90-9993-2addb9a4da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.195822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48671196fd864811bb26b19725d3f6e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.200104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-27cffd02-59a8-4a90-9993-2addb9a4da95 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:41.202651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-27cffd02-59a8-4a90-9993-2addb9a4da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.224017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48671196fd864811bb26b19725d3f6e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.236232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48671196fd864811bb26b19725d3f6e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.237054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48671196fd864811bb26b19725d3f6e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.263980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-03f95bcf-4e58-4870-aa4b-df538264df20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48671196fd864811bb26b19725d3f6e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:41.296687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1087/2166] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:41 2022] DELETE /identity/v3/users/48671196fd864811bb26b19725d3f6e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:41.298414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480e32-6578-4006-983e-042d044fccd5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.298704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480e32-6578-4006-983e-042d044fccd5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.298981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56480e32-6578-4006-983e-042d044fccd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.332271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-56480e32-6578-4006-983e-042d044fccd5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:41.333504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-56480e32-6578-4006-983e-042d044fccd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.336413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1080/2167] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:41.337991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.338322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.338797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.364143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:41.365455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.468457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1088/2168] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:41.473739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480e32-6578-4006-983e-042d044fccd5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.491177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1081/2169] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:41.493375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56480e32-6578-4006-983e-042d044fccd5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.495678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.497939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.509950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.510778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.510989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.511552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.512289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:41.512600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.514280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.538133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1089/2170] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:41.542423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.554410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:41.585856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51b03-b287-46be-8cc5-2ef03a93d014 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.593046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.594611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.594895 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.595179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.609610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.612003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.624636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1082/2171] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:42:41.625550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.631458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4a6ec-57f2-48f5-aa89-b397f8d8a01c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.635845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d2ec5-cc80-4df2-bfe2-567a7834a224 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.636913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.637569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.637849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.638123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.643613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.644482 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.644909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.645326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.646162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.648537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.649605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.652052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.663055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1090/2172] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:41.680717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1083/2173] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:41.685447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.696685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f12da66-efdc-4039-bf19-c9de9cc93f70 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.767715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.768620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.768985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.769334 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.770096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.772288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.809549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1091/2174] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:41.811074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.822547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b8072-3616-454c-b844-faa88baa0848 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.828235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.829064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.829525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.829897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.830714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.832474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.847585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1084/2175] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:41.851721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.863585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf20d32-5076-4c37-9992-3af6d9a13bbb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.868456 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.869256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.870086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.870086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.871011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.872750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbebb67-6a6a-43a1-91dc-1b46be5cd6f9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.886889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1092/2176] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:41.888830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:41.899108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cfe56-f0a3-45d9-a7b8-3df6bec2f33e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:41.905230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:41.906560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.906924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.907331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] PATH_INFO: `/v3/projects/ee66d81ea92041cab173ee39d2929456/users/4659bfb748294775b81b1dff3e77c5f8/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.924172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee66d81ea92041cab173ee39d2929456, user_id=4659bfb748294775b81b1dff3e77c5f8, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:41.927174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:41.945697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1085/2177] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:41 2022] PUT /identity/v3/projects/ee66d81ea92041cab173ee39d2929456/users/4659bfb748294775b81b1dff3e77c5f8/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:41.950908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:41.951300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:41.952675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:41.973812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:41.975119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.049372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1093/2178] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:42.057656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.115223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf43eb07-06c9-44fc-8384-361b2f851cf2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.119728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.120183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.120531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.120800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.131405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.133334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5718d-7c1e-490f-ae21-e25e17d8d517 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:42.144471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1086/2179] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:42.257872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.259222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.282246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd4ba2-e5d8-44c2-8ec4-1cc83047f8d0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.289183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.290568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.291230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.294321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4516-e113-4126-a929-0a3812d856da None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.294661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4516-e113-4126-a929-0a3812d856da None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.294943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac4516-e113-4126-a929-0a3812d856da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.306858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] PATH_INFO: `/v3/projects/609c36b7955848e3be1d400cc8e5cce8` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.311734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609c36b7955848e3be1d400cc8e5cce8)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.317745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:42.340527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8aac4516-e113-4126-a929-0a3812d856da None None] MFA Rules not processed for user `c9109b244aef49a1a29050bb055c0ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:42.343898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8aac4516-e113-4126-a929-0a3812d856da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.451259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609c36b7955848e3be1d400cc8e5cce8', 'request_id': 'req-206a0ab4-36f1-4451-95e3-a96de5776c76'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.456700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1087/2180] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:42.459153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609c36b7955848e3be1d400cc8e5cce8', 'request_id': 'req-206a0ab4-36f1-4451-95e3-a96de5776c76'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.459341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac4516-e113-4126-a929-0a3812d856da None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.462818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8aac4516-e113-4126-a929-0a3812d856da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.467874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609c36b7955848e3be1d400cc8e5cce8', 'request_id': 'req-206a0ab4-36f1-4451-95e3-a96de5776c76'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.493483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] The token cache is being invalidate because project 609c36b7955848e3be1d400cc8e5cce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:42.493792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.496254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.504492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1094/2181] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:42 2022] DELETE /identity/v3/projects/609c36b7955848e3be1d400cc8e5cce8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:42.505564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.508880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac4516-e113-4126-a929-0a3812d856da None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.510346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.626390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0ab4-36f1-4451-95e3-a96de5776c76 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.628002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.629054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.629488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.629898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] PATH_INFO: `/v3/projects/92ab90f5a74549468110ed0afa290920` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.631516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ab90f5a74549468110ed0afa290920)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.634144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.634955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:42.635669 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.635965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.636345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] PATH_INFO: `/v3/users/52df1220967246e3bfb140f504d43bc6` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.638390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52df1220967246e3bfb140f504d43bc6)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.641417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:42.702931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52df1220967246e3bfb140f504d43bc6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.704217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ab90f5a74549468110ed0afa290920', 'request_id': 'req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.709672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ab90f5a74549468110ed0afa290920', 'request_id': 'req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.715498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52df1220967246e3bfb140f504d43bc6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.716159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ab90f5a74549468110ed0afa290920', 'request_id': 'req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.723106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52df1220967246e3bfb140f504d43bc6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.723989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52df1220967246e3bfb140f504d43bc6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.732364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] The token cache is being invalidate because project 92ab90f5a74549468110ed0afa290920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:42.732866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.733007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e19de15d-73d0-4985-ad1f-39d1ede9cd3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52df1220967246e3bfb140f504d43bc6'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.733981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2facfc33-6e48-4ad8-9fcf-1d859ab7a929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:42.736032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1088/2182] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:42 2022] DELETE /identity/v3/projects/92ab90f5a74549468110ed0afa290920 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:42.739685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1095/2183] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:42 2022] DELETE /identity/v3/users/52df1220967246e3bfb140f504d43bc6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:42.740598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.741075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.741421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.771676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:42.772943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.879639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1089/2184] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:42.887238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.888032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.888032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.912312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:42.913975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:42.931132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1096/2185] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:42.935299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.945075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f2ba8-511a-4cdd-af7e-2860d87f29fb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.949637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.950330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.950603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.950878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.951643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:42.952266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.954090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:42.966720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1090/2186] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:42.971046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:42.981446 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e0848-4fad-45e2-aed4-f76199c2c542 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:42.986261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:42.986923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:42.987202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:42.987515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:42.988330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:42.990240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.017696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1097/2187] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:43.022058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.032437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9e1498-2ad8-43d1-9788-017be1b8431c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.089711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.090477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.090756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.091030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.091769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.093695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.114649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1091/2188] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:43.118973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.129493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cf756-1371-4b37-8cd4-3bbfdb283c83 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.134878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.136196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.136196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.136391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.137317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.138947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.150259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1098/2189] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:43.155526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.165518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f565e-d357-40b0-b4db-32245e5c3a0e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.170429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.171079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.171351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.171660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.172361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.173953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d02fc-b4da-4eb7-98f5-7d1a5483704a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.184074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1092/2190] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:43.188175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.199011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a885f-74b9-43c9-852f-47d112416b0e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.205390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.206288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.206568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.206842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] PATH_INFO: `/v3/projects/7898995e41684b029b6370132bc5d1ac/users/d08477bbef5144c7a0c685e938b78b92/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.222915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7898995e41684b029b6370132bc5d1ac, user_id=d08477bbef5144c7a0c685e938b78b92, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.225638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.238259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1099/2191] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:43 2022] PUT /identity/v3/projects/7898995e41684b029b6370132bc5d1ac/users/d08477bbef5144c7a0c685e938b78b92/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:43.243965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.247874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.248174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.279150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:43.280787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:43.309132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.311340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:43.344136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1093/2192] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:43.353884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.355537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:43.380385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee565af6-b3a5-49ce-ba43-c23a65e7391d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.388912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.389788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.390406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.390829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] PATH_INFO: `/v3/projects/ebe876d976f1489caaeca3c2e649336f` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.392351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe876d976f1489caaeca3c2e649336f)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.394454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.424997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de839d4b-ccbb-42cf-82b9-c67c0b711684 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.434058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.435244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.435548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.436288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.449408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.450840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029dbdcd-ee03-4169-a8ee-bd2850017a44 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.463069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1094/2193] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:43.463581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe876d976f1489caaeca3c2e649336f', 'request_id': 'req-0768f745-e4d7-4490-8cd0-35ac47803a5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:43.472295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe876d976f1489caaeca3c2e649336f', 'request_id': 'req-0768f745-e4d7-4490-8cd0-35ac47803a5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:43.482128 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe876d976f1489caaeca3c2e649336f', 'request_id': 'req-0768f745-e4d7-4490-8cd0-35ac47803a5d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:43.503153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] The token cache is being invalidate because project ebe876d976f1489caaeca3c2e649336f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:43.503784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:43.504832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0768f745-e4d7-4490-8cd0-35ac47803a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:43.507305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1100/2194] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:43 2022] DELETE /identity/v3/projects/ebe876d976f1489caaeca3c2e649336f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:42:43.513264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.513551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.513827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.540819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:43.542123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:43.656135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1095/2195] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:43.665160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.665764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.666108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.697792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:43.702665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:43.720459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1101/2196] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:43.724922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.737750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ef6aa-0f9c-4c9d-bf23-3d18f9debc6b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.749594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.750270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.750546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.750812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.751673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:43.751972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.756446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.787251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1096/2197] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:43.788482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.801657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd6406-d66b-4a41-886f-fafd0195368d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:43.813967 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:43.816805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:43.818248 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:43.818651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:43.821371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:43.828517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:43.913631 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1102/2198] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:43.915192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:43.925691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a23df1-7e66-4d92-b14d-1a882fa62f16 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.008982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.010321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.010607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.010943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.012200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.014586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.046145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1097/2199] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:43 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:44.047049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.062505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c76151-35a2-48f4-afa1-a2314e694382 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.074744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.077677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.078141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.079030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.080883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.096963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.128117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.140069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1103/2200] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:42:44.141711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc24501-cf3f-4b53-bf5b-d04758c95651 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.148924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.150415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.150860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.151784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.152693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.155663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517620b-db2a-4401-8705-4b3209ceb3b4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.174574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.175681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1098/2201] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:44.186800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f7e8d-ddd9-4aec-a5e9-703eda779128 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.193643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.194793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.195240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.195713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] PATH_INFO: `/v3/projects/c681da6158874f1d9c494569c941d0c7/users/c51ced776cd540aead63ee2c0d6733b5/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.226306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c681da6158874f1d9c494569c941d0c7, user_id=c51ced776cd540aead63ee2c0d6733b5, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.229450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.259057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1104/2202] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:44 2022] PUT /identity/v3/projects/c681da6158874f1d9c494569c941d0c7/users/c51ced776cd540aead63ee2c0d6733b5/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:44.270404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.270689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.271500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.302209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] MFA Rules not processed for user `c51ced776cd540aead63ee2c0d6733b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:44.303720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:44.377901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1099/2203] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:44.382384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.463429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cca98e-6437-4122-9657-a2cf5381db1c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.470519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.471196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.471578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.472052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.472933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.475278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.512192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1105/2204] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:44 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:44.512436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.526840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e64eb1-f6fb-4859-9a7e-339bdb119d59 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.609470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.610213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.610499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.610772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.626278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.632221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0021d-c46a-4ea1-99c4-9ad6e772dcfa admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.686220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1100/2205] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:44 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:42:44.690549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.720229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbe6e5-13f9-4d63-823a-d9ac5aa29273 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.729111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.729903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.731978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.732306 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.737186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.738851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.741200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.741650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.743246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.767892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1106/2206] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:44.768956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.785200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] MFA Rules not processed for user `d08477bbef5144c7a0c685e938b78b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:44.787089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:44.792510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8adc7-80f6-4e6d-b93b-a2a82b6958be admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:44.806533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:44.807690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:44.808214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:44.808905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] PATH_INFO: `/v3/projects/00d9a9ce1a9a47979fe769a829259bcf/users/c69c024c67064bb7a11ba99c473d50e7/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:44.842947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d9a9ce1a9a47979fe769a829259bcf, user_id=c69c024c67064bb7a11ba99c473d50e7, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:44.848546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:44.883803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1107/2207] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:44 2022] PUT /identity/v3/projects/00d9a9ce1a9a47979fe769a829259bcf/users/c69c024c67064bb7a11ba99c473d50e7/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:44.888978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:44.987919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1101/2208] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:44.999887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:45.001485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:45.067077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657fe16-891b-4114-b7d2-5211849dfc59 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:45.073504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:45.074355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:45.074652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:45.075132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:45.075980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:45.078259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:45.096632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1108/2209] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:42:45.101865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:45.105016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854084-2c3a-40bd-bd87-e8b9f8dc4ddb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:45.141718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5927ce-4a7a-4464-826b-07e0a916178c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:45.154156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:45.155243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:45.155733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:45.156185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] PATH_INFO: `/v3/projects/00d9a9ce1a9a47979fe769a829259bcf/users/c69c024c67064bb7a11ba99c473d50e7/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:45.158421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d9a9ce1a9a47979fe769a829259bcf, user_id=c69c024c67064bb7a11ba99c473d50e7, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:45.164894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:45.165653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:45.166039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:45.166314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e632a7-41ab-4364-8191-89ae71ed6169 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:45.166479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:45.192282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1109/2210] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:45 2022] PUT /identity/v3/projects/00d9a9ce1a9a47979fe769a829259bcf/users/c69c024c67064bb7a11ba99c473d50e7/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:45.195124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:45.195124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:45.195124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:45.252729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:45.260564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:45.269579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] MFA Rules not processed for user `c69c024c67064bb7a11ba99c473d50e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:45.283238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1102/2211] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:45.288579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:45.431532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1110/2212] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:45.809025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:45.817831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a33816-8920-425d-a193-1144e0c3f8db service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:45.942168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:45.942865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:45.943141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:45.943435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:45.955136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:45.956532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5519c43-cbd1-4144-8158-a972e76ba57a service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:45.984849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1103/2213] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:46.963826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:47.029156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a92dfc-217d-467a-8ecd-459f1e2893a5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:47.036336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:47.037233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:47.037517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:47.037822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] PATH_INFO: `/v3/users/c51ced776cd540aead63ee2c0d6733b5` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:47.039150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c51ced776cd540aead63ee2c0d6733b5)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:47.042450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:47.120754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c51ced776cd540aead63ee2c0d6733b5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:47.144769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c51ced776cd540aead63ee2c0d6733b5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:47.156719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c51ced776cd540aead63ee2c0d6733b5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:47.157980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c51ced776cd540aead63ee2c0d6733b5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:47.170826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43647cd5-ed4b-4655-be12-493355295700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c51ced776cd540aead63ee2c0d6733b5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:47.181012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1111/2214] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:46 2022] DELETE /identity/v3/users/c51ced776cd540aead63ee2c0d6733b5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:47.192650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:47.194246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:47.194724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:47.247203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:47.247526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:47.247806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:47.248015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:47.251220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:47.265245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] MFA Rules not processed for user `d08477bbef5144c7a0c685e938b78b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:47.266710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:47.324293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1112/2215] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:47.380618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1104/2216] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:47.388056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:47.389467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:47.476103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73905fe6-3b33-4d5e-9776-d3a59ab40932 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:47.482150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:47.482939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:47.483991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:47.484209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:47.519886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:47.521359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:47.532354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1113/2217] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:48.126961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.128391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:48.152805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408f513-21ba-44bb-997e-a5b6756e8c0e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.158781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.160071 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.160351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.160624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] PATH_INFO: `/v3/projects/c681da6158874f1d9c494569c941d0c7` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.161843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c681da6158874f1d9c494569c941d0c7)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.163786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.284061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c681da6158874f1d9c494569c941d0c7', 'request_id': 'req-da1c7316-de21-4dc7-85d6-5dd525c8df18'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.308837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c681da6158874f1d9c494569c941d0c7', 'request_id': 'req-da1c7316-de21-4dc7-85d6-5dd525c8df18'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.320452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c681da6158874f1d9c494569c941d0c7', 'request_id': 'req-da1c7316-de21-4dc7-85d6-5dd525c8df18'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.342751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] The token cache is being invalidate because project c681da6158874f1d9c494569c941d0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:48.343123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.345438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.348807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1105/2218] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:48 2022] DELETE /identity/v3/projects/c681da6158874f1d9c494569c941d0c7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:48.352809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:48.365450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfcb4f-2e05-4a8f-a8ca-ce828662c3f0 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:48.518130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:48.519518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:48.521225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:48.521681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] PATH_INFO: `/v3/users/c69c024c67064bb7a11ba99c473d50e7` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:48.527256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c69c024c67064bb7a11ba99c473d50e7)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:48.534639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:48.678307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c69c024c67064bb7a11ba99c473d50e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.703975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c69c024c67064bb7a11ba99c473d50e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.720194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c69c024c67064bb7a11ba99c473d50e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.721813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c69c024c67064bb7a11ba99c473d50e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.737905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-778fcbc5-6f55-4c9d-9191-e6209127051f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c69c024c67064bb7a11ba99c473d50e7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:48.749656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1114/2219] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:48 2022] DELETE /identity/v3/users/c69c024c67064bb7a11ba99c473d50e7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:49.225605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.227511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.248728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c7316-de21-4dc7-85d6-5dd525c8df18 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.330493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.332161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.332893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.333373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] PATH_INFO: `/v3/projects/00d9a9ce1a9a47979fe769a829259bcf` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.337315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d9a9ce1a9a47979fe769a829259bcf)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.339987 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.417100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d9a9ce1a9a47979fe769a829259bcf', 'request_id': 'req-1946077e-b261-47a8-9038-f7e230def309'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.429624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d9a9ce1a9a47979fe769a829259bcf', 'request_id': 'req-1946077e-b261-47a8-9038-f7e230def309'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.437496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d9a9ce1a9a47979fe769a829259bcf', 'request_id': 'req-1946077e-b261-47a8-9038-f7e230def309'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.462208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] The token cache is being invalidate because project 00d9a9ce1a9a47979fe769a829259bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:49.462515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.463330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-1946077e-b261-47a8-9038-f7e230def309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:49.465300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1106/2220] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:49 2022] DELETE /identity/v3/projects/00d9a9ce1a9a47979fe769a829259bcf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:49.472429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.473003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.473003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.523417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:49.524663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.631148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1115/2221] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:49.641120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.641598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.641866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.670404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:49.672441 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:49.686748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1107/2222] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:49.688402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.701147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fed1d3-d183-4ed0-a31f-bfb775c1f53a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.717400 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.718232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.718512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.718787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.719555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:49.719858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.721482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.743611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1116/2223] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:49.748277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.758006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e092051-88b5-4a31-9a5e-fafdc9cf4a8b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.765327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.767006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.768009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.769952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.770692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.775724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2beca8-5d19-46a0-b972-01a786eaae23 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.851911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1108/2224] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:49.853667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:49.866469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c70646-86c1-4718-af25-85feb8a6e03b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:49.970821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:49.971566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.971850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.972132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:49.972849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:49.980402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:49.998229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:49.998545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:49.998967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.041198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1117/2225] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:42:50.042472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.045471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] MFA Rules not processed for user `4659bfb748294775b81b1dff3e77c5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:50.047171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:50.067090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74ab27-29ad-44ee-a59b-39c96d5f1791 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.080097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.081706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.081984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.082259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.083146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.085153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.102458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1118/2226] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:42:50.105595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.124431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfa006-157d-4bac-bf6d-f221ac1d196d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.144665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.145652 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.146076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.146479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.147367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.149063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.173814 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1119/2227] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:50.186264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.206822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1109/2228] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:50.206822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.207785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:50.218720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a3d8-e908-4daf-adaa-18b27ac08852 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.234422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.235331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.235770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.236039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] PATH_INFO: `/v3/projects/08af976fb836432389efed1ea1d6fa1a/users/68fbcdc105144e7a9580b6f1ceb280f8/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.237105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ba5c78-5d2c-4576-9572-e47872f37fbe None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.249451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.250610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.250992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.251364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.252273 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.255154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.276779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08af976fb836432389efed1ea1d6fa1a, user_id=68fbcdc105144e7a9580b6f1ceb280f8, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.279533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4614c2-95d5-4fe7-9a14-753d0a624364 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.307227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1120/2229] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:50 2022] PUT /identity/v3/projects/08af976fb836432389efed1ea1d6fa1a/users/68fbcdc105144e7a9580b6f1ceb280f8/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:50.309434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.309807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.310668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.340065 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1110/2230] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:50 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:50.342287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.344018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:50.345237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:50.416735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501991f7-f9c6-4752-ade4-37190083962f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.422572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.423540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.424259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.424681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.425533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.428743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.469855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1111/2231] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:50 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:42:50.471617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1121/2232] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:50.474088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.485160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542c168-b3a9-44cc-9bae-822c4e4be1d2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.487308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.488845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:50.506157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.509602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.510769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.511413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.513122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.516521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.534247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1112/2233] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:42:50.540509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.573558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af85971-a8f4-451e-af53-ffeaee2a6338 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.574250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85762ae9-c893-4680-a6d2-1ceceef16471 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.581004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.582204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.582731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.583269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.583445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.584451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.584851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.585316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] PATH_INFO: `/v3/projects/73893551e77c46849e05b827694b1030/users/86a1904bef4e4449bbc214d351f263c1/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.594855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.596789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.608185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73893551e77c46849e05b827694b1030, user_id=86a1904bef4e4449bbc214d351f263c1, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.611253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.616151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1122/2234] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:50.636675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1113/2235] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:50 2022] PUT /identity/v3/projects/73893551e77c46849e05b827694b1030/users/86a1904bef4e4449bbc214d351f263c1/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:50.641143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.654060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99675ada-5ccc-4b75-adfa-4ef862a92134 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.726904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.728347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.728944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.729444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.730359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.732270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd115ffe-54b1-4750-aea8-8621ab9e6d1e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.746107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1123/2236] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:50.751585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:50.769354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33594-2543-41c1-9fba-32474922abe6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:50.775436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:50.776410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:50.776889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:50.777335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] PATH_INFO: `/v3/projects/73893551e77c46849e05b827694b1030/users/86a1904bef4e4449bbc214d351f263c1/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:50.779566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73893551e77c46849e05b827694b1030, user_id=86a1904bef4e4449bbc214d351f263c1, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:50.784310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:50.801375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1114/2237] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:50 2022] PUT /identity/v3/projects/73893551e77c46849e05b827694b1030/users/86a1904bef4e4449bbc214d351f263c1/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:52.673531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:52.674080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:52.674080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:52.710173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] MFA Rules not processed for user `68fbcdc105144e7a9580b6f1ceb280f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:52.712702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:52.809866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1124/2238] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:52.814624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:52.902211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49713-3a4d-403b-b472-7e7481bce6e7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:52.908203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:52.909258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:52.909867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:52.910995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:52.912248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:52.914473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:52.951142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1115/2239] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:52 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:52.955765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:52.968512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76439-0200-4551-9fe3-6cc6d82e3ce0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.062084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.062339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.062621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.063205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.063894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.066266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.107339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1125/2240] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:52 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:53.109633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.140535 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbec83-675c-4c5e-a746-f48f29c1334e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.155842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.156403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.156686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.156951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.157692 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.161368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.178644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1116/2241] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:53.179880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.194058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775e534d-6272-42a6-a840-343c639b30f7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.198825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.199726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.199999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.200267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] PATH_INFO: `/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310/users/f27a224d6a7c47a2a18950f6d59b8c68/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.219957 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cc60d9d4ca4e9fa9e8556633a4e310, user_id=f27a224d6a7c47a2a18950f6d59b8c68, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.222724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.240855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1126/2242] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:53 2022] PUT /identity/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310/users/f27a224d6a7c47a2a18950f6d59b8c68/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:53.243659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.258044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370c47c-3621-4d93-841c-2b0742cdc927 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.328153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.329033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.329403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.329769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.330594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.332422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.347002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1117/2243] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:53.358451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.380476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.383793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:53.384710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9001b69-c4b4-4028-bfd4-d1d93b3a24a2 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.395259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13addfd0-5181-4b54-9c7d-1596ddcfee2e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:53.399690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.400769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:53.401616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.401902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.402053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.403965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] PATH_INFO: `/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310/users/f27a224d6a7c47a2a18950f6d59b8c68/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.404116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.404116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] PATH_INFO: `/v3/users/6f42ef31a8394831aa34cb1296033dba` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.405064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f42ef31a8394831aa34cb1296033dba)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.405313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cc60d9d4ca4e9fa9e8556633a4e310, user_id=f27a224d6a7c47a2a18950f6d59b8c68, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:53.408791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f59da6-2d45-4e28-aeca-063cb0b97bcf admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.410216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:53.436964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1127/2244] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:53 2022] PUT /identity/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310/users/f27a224d6a7c47a2a18950f6d59b8c68/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:53.540711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f42ef31a8394831aa34cb1296033dba'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:53.549169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f42ef31a8394831aa34cb1296033dba'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:53.584900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f42ef31a8394831aa34cb1296033dba'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:53.586448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f42ef31a8394831aa34cb1296033dba'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:53.626387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f42ef31a8394831aa34cb1296033dba'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:53.635268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1118/2245] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:42:53 2022] DELETE /identity/v3/users/6f42ef31a8394831aa34cb1296033dba => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:53.643231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36279-d599-4576-8a05-977972389000 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:53.643702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36279-d599-4576-8a05-977972389000 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:53.644307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e36279-d599-4576-8a05-977972389000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:53.701516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c0e36279-d599-4576-8a05-977972389000 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:53.704268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c0e36279-d599-4576-8a05-977972389000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:53.790698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1128/2246] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:53.876397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:53.879958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:54.036893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7e612-c507-48f7-b40e-dba7fbf21978 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:54.047992 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:54.050470 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:54.051001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:54.051811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:54.079314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:54.082068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a5e88-9cbd-40b9-b901-734860bfb742 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:54.114619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1119/2247] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:54.834584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36279-d599-4576-8a05-977972389000 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:54.836807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c0e36279-d599-4576-8a05-977972389000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:54.862517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e36279-d599-4576-8a05-977972389000 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:54.868438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:54.871806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:54.872282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:54.872701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] PATH_INFO: `/v3/projects/12b888fe615b4584acf7364af716b7b1` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:54.875193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b888fe615b4584acf7364af716b7b1)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:54.877731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:54.943202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b888fe615b4584acf7364af716b7b1', 'request_id': 'req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:54.954681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b888fe615b4584acf7364af716b7b1', 'request_id': 'req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:54.973089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:54.974221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:54.974667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:54.979289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b888fe615b4584acf7364af716b7b1', 'request_id': 'req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:54.998081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] The token cache is being invalidate because project 12b888fe615b4584acf7364af716b7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:42:54.998465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:54.999443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bbf6b221-7e9f-4fe6-a5c3-f8969b72c36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:42:55.001499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1129/2248] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:42:54 2022] DELETE /identity/v3/projects/12b888fe615b4584acf7364af716b7b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:42:55.008048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6a78-f68b-45f4-aa26-f37c11ea8c97 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.009189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6a78-f68b-45f4-aa26-f37c11ea8c97 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.009616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf6a78-f68b-45f4-aa26-f37c11ea8c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.030058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] MFA Rules not processed for user `f27a224d6a7c47a2a18950f6d59b8c68`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:55.037603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:55.061000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-fbdf6a78-f68b-45f4-aa26-f37c11ea8c97 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:55.062316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fbdf6a78-f68b-45f4-aa26-f37c11ea8c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:55.177410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1120/2249] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:55.189501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.192771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:55.316278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1130/2250] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:55.323948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.324234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.324632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.357907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:55.359108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:55.374342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1131/2251] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:42:55.384414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.387785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fd313-3810-41e6-87e5-2d2e3c9ca971 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.395847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.396613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.396888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.397156 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.402734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:55.404153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f6c5c-ebc7-4a8a-959e-78eb0a5443dc None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.410208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.410978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.411538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.411883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.412813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:42:55.413183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.415086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.431046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1132/2252] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:42:55.437291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.448356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7082f-a56d-4f03-bb26-d4c0c8a4ddc9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.459905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.460589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.460868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.461139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.461836 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.463831 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.500152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1133/2253] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:42:55 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:42:55.504259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.513578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.522090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.534699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1121/2254] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:55.610642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a12da8-e0e9-49f9-868d-54ff7ed6ce80 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.615731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.616458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.616732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.617002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.617711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.619851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.651601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1134/2255] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:42:55 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:42:55.656150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.672729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b013f53-5018-411d-9d76-0892ae9ed88e service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.696604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.702516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.703997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.704740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.705707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.710829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.741108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1122/2256] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:42:55.746214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.761634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5f1db-75c8-483d-adfe-7e5cd152da42 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.769089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.769934 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.770320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.770665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.772162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.773930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd61f11-5dbd-4451-a4d9-32f7240bbd9e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.791774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1135/2257] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:42:55.793350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:55.806008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17972-6c11-4ab6-b867-c06556dfcc60 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:55.820284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:55.822261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.822614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.822982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] PATH_INFO: `/v3/projects/1f0f0977865f41eb9c89a334d9d20594/users/fb63df45502e4e13adc3658c0554fe6c/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.840517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f0f0977865f41eb9c89a334d9d20594, user_id=fb63df45502e4e13adc3658c0554fe6c, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:55.843928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:55.876889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1123/2258] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:42:55 2022] PUT /identity/v3/projects/1f0f0977865f41eb9c89a334d9d20594/users/fb63df45502e4e13adc3658c0554fe6c/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:42:55.877710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:55.878091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:55.878286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:55.918590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] MFA Rules not processed for user `fb63df45502e4e13adc3658c0554fe6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:55.919889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:56.012913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1136/2259] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:56.024513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:56.116447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859c217-e741-4f8a-9cd9-e25b339850ba admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:56.125257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:56.131798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:56.141492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:56.143135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:56.161621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:56.163226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f3494-1361-43d3-a402-96e54a14f9dc service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:56.177666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1124/2260] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:57.087720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:57.108004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a3e1-3229-4c58-b08e-1e6a34e0a597 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:57.125737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:57.126561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:57.126847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:57.127879 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:57.235911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:57.236996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:57.272762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1137/2261] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:42:59.170239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:59.170726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:59.170828 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:59.202911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] MFA Rules not processed for user `86a1904bef4e4449bbc214d351f263c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:42:59.204611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:59.287959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1125/2262] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:42:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:42:59.300895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:42:59.302312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:59.429850 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f872e6-916c-41f2-b19b-611cfb96862e service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:42:59.440885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:42:59.442325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:42:59.442666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:42:59.442953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:42:59.445278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:42:59.514215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:42:59.515742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:42:59.526925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1138/2263] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:42:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:04.954485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:04.960958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:05.089995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07fb5-e8b7-49b8-8f13-0d68b01274c1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:05.095698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:05.096589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:05.097069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:05.097336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:05.100196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:05.112290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:05.114078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c1e18-fc8f-4a4f-a7d3-aaed4b721907 service placement] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:05.125101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1126/2264] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:07.534434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:07.601271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d404f8-2c93-43cd-b186-73eba662241d service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:07.607519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:07.608423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:07.608701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:07.608963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] PATH_INFO: `/v3/users/fb63df45502e4e13adc3658c0554fe6c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:07.610331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb63df45502e4e13adc3658c0554fe6c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:07.612323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:07.667227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb63df45502e4e13adc3658c0554fe6c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:07.678913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb63df45502e4e13adc3658c0554fe6c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:07.685718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb63df45502e4e13adc3658c0554fe6c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:07.686425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb63df45502e4e13adc3658c0554fe6c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:07.696529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb63df45502e4e13adc3658c0554fe6c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:07.703133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1139/2265] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:07 2022] DELETE /identity/v3/users/fb63df45502e4e13adc3658c0554fe6c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:07.707756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:07.708234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:07.708326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:07.726398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:07.727624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:07.793484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1127/2266] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:07.804421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:07.807002 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:07.870857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc47c08-5640-4cc9-8f42-2277a0c1ad23 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:07.880409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:07.881088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:07.881371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:07.881646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:07.892044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:07.893507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:07.904406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1140/2267] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:08.710759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:08.712322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:08.725833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ecee8-6e5d-419a-a867-73ab4830ca85 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:08.730110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:08.730968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:08.731282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:08.731585 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:08.738711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:08.740188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:08.740664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:08.765395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d8aeb-62a7-43d4-9fdf-91fea08110b6 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:08.770399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:08.771286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:08.771591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:08.771858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] PATH_INFO: `/v3/projects/1f0f0977865f41eb9c89a334d9d20594` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:08.773202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f0f0977865f41eb9c89a334d9d20594)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:08.775176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:08.811723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:08.813383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:08.824430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1128/2268] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:08.829679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f0f0977865f41eb9c89a334d9d20594', 'request_id': 'req-a35de320-2b2a-4128-8981-28ce4d39e0fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:08.836436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f0f0977865f41eb9c89a334d9d20594', 'request_id': 'req-a35de320-2b2a-4128-8981-28ce4d39e0fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:08.843458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f0f0977865f41eb9c89a334d9d20594', 'request_id': 'req-a35de320-2b2a-4128-8981-28ce4d39e0fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:08.857217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] The token cache is being invalidate because project 1f0f0977865f41eb9c89a334d9d20594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:08.858055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:08.860450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:08.867470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1141/2269] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:08 2022] DELETE /identity/v3/projects/1f0f0977865f41eb9c89a334d9d20594 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:12.515370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:12.517015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:12.530701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c7503-9122-41d2-9291-f31f0dd74580 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:12.591786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:12.592691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:12.592994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:12.593260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] PATH_INFO: `/v3/users/68fbcdc105144e7a9580b6f1ceb280f8` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:12.594421 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fbcdc105144e7a9580b6f1ceb280f8)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:12.596376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:12.648109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fbcdc105144e7a9580b6f1ceb280f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:12.657586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fbcdc105144e7a9580b6f1ceb280f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:12.672440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fbcdc105144e7a9580b6f1ceb280f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:12.673197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fbcdc105144e7a9580b6f1ceb280f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:12.683229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fbcdc105144e7a9580b6f1ceb280f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:12.690225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1129/2270] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:12 2022] DELETE /identity/v3/users/68fbcdc105144e7a9580b6f1ceb280f8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:12.880251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:12.881986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:12.894839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35de320-2b2a-4128-8981-28ce4d39e0fd admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:12.958198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:12.959193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:12.959561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:12.959988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] PATH_INFO: `/v3/projects/08af976fb836432389efed1ea1d6fa1a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:12.961586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08af976fb836432389efed1ea1d6fa1a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:12.964220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.015613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08af976fb836432389efed1ea1d6fa1a', 'request_id': 'req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.022512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08af976fb836432389efed1ea1d6fa1a', 'request_id': 'req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.029478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08af976fb836432389efed1ea1d6fa1a', 'request_id': 'req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.044228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] The token cache is being invalidate because project 08af976fb836432389efed1ea1d6fa1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:13.044525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.045597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.046839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1142/2271] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:12 2022] DELETE /identity/v3/projects/08af976fb836432389efed1ea1d6fa1a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:13.050820 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.052280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:13.065894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a469a-ebb5-4466-a94c-56eea7862ea5 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.124645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.125576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.125848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.126117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] PATH_INFO: `/v3/users/f27a224d6a7c47a2a18950f6d59b8c68` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.127414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27a224d6a7c47a2a18950f6d59b8c68)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.129392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.182678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27a224d6a7c47a2a18950f6d59b8c68'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.189327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27a224d6a7c47a2a18950f6d59b8c68'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.203069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27a224d6a7c47a2a18950f6d59b8c68'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.203879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27a224d6a7c47a2a18950f6d59b8c68'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.213246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-c7a2f6e5-53ad-4422-a17f-7a7f46b701e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27a224d6a7c47a2a18950f6d59b8c68'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.220221 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1130/2272] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:13 2022] DELETE /identity/v3/users/f27a224d6a7c47a2a18950f6d59b8c68 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:13.410365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.413048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:13.427958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91276fd4-ea47-4cd5-ac1a-2bb06711f43b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.492886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.493884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.494166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.494441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] PATH_INFO: `/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.495639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99cc60d9d4ca4e9fa9e8556633a4e310)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.497555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.542782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99cc60d9d4ca4e9fa9e8556633a4e310', 'request_id': 'req-d38c76e2-7d66-41c2-8875-b10412fb89b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.548533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99cc60d9d4ca4e9fa9e8556633a4e310', 'request_id': 'req-d38c76e2-7d66-41c2-8875-b10412fb89b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.555053 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99cc60d9d4ca4e9fa9e8556633a4e310', 'request_id': 'req-d38c76e2-7d66-41c2-8875-b10412fb89b2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.569402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] The token cache is being invalidate because project 99cc60d9d4ca4e9fa9e8556633a4e310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:13.569692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.570313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d38c76e2-7d66-41c2-8875-b10412fb89b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:13.572064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1143/2273] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:13 2022] DELETE /identity/v3/projects/99cc60d9d4ca4e9fa9e8556633a4e310 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:13.578641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.579269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.579269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.597988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:13.599230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:13.663858 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1131/2274] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:13.672187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.672437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.672718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.692969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:13.694115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:13.703739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1144/2275] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:13.708332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.718823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aba46f-215d-48cb-8dba-18bc018964e4 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.724390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.725059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.725342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.725619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.726356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:43:13.726661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.728336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.740499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1132/2276] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:43:13.744761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.753881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664b484-1171-4218-8f4f-0a68f0d7f6b5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.759343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.760043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.760322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.760595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.761291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.763193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.795535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1145/2277] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:43:13 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:13.797148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.810509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d702a-1390-4e7f-8949-949b90b19b0c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.876173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.876877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.877158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.877431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.878155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.880531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.909125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1133/2278] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:43:13 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:13.915147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.926676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d38a48-1fc8-4fb1-8c69-31b4c83f31b1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.932224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.933177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.933584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.933987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.934987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.937337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.949646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1146/2279] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:13.954167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:13.966342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405b01d3-2cc2-434c-b72f-c96182e04b98 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:13.976112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:13.977122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:13.977395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:13.977660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:13.978725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:13.980422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb17dc-1ebb-4dfc-a93d-30ce08fee88e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:13.992056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1134/2280] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:13.996800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.007610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0bb5f-dfb0-416a-a268-8aa98232c586 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.013751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.014658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.014940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.015209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] PATH_INFO: `/v3/projects/56821d90350f4533a74061979d24cae9/users/142c5717158c4adb86fa41f60fdd19c2/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.031028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56821d90350f4533a74061979d24cae9, user_id=142c5717158c4adb86fa41f60fdd19c2, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.033781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.049543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1147/2281] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:43:13 2022] PUT /identity/v3/projects/56821d90350f4533a74061979d24cae9/users/142c5717158c4adb86fa41f60fdd19c2/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:14.060120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.060405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.060677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.095048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] MFA Rules not processed for user `142c5717158c4adb86fa41f60fdd19c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:14.096415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:14.161448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1135/2282] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:14.166247 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.229261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a28ac-98a7-4ece-9bce-1e0a0e0fe929 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.234207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.234875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.235150 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.235437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.236132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.238050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.269270 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1148/2283] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:14.273255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.284181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770568-e0e6-43f9-9e37-b316e16a3cde None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.350784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.351503 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.351785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.352053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.352733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.354733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.375567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1136/2284] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:14.379751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.390482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807514-635f-4a93-806b-8bc1efec5612 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.396126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.396793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.397067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.397340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.398060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.399685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.410574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1149/2285] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:43:14.414570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.424468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff151e-489c-4a30-8c92-01e8dca74ed7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.429969 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.430683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.430958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.431305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.432098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.433696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb245e81-6623-4785-a558-2a39fcb994ca admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.443726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1137/2286] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:14.448144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.458901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9398e41-ecc3-4ac9-a3bf-23ed1b7d46be admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.465488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.466568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.466842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.467116 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] PATH_INFO: `/v3/projects/bab66570cfe848a1a7122098ed74c790/users/3b3061de1d8f477684c66f3eccff1f34/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.484425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab66570cfe848a1a7122098ed74c790, user_id=3b3061de1d8f477684c66f3eccff1f34, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.487459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.502874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1150/2287] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:43:14 2022] PUT /identity/v3/projects/bab66570cfe848a1a7122098ed74c790/users/3b3061de1d8f477684c66f3eccff1f34/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:14.514162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.514456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.514733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.542462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] MFA Rules not processed for user `3b3061de1d8f477684c66f3eccff1f34`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:14.543776 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:14.616416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1138/2288] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:14.624195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.695989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a6eb-d589-47ff-809b-e12f1539db6f admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.701834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.702505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.702787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.703064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.703788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.705704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.733643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1151/2289] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:14.738384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.750176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1294e3-767b-4ccc-a4e1-9269b0fd78ae None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.811472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.812177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.812443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.812722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.813420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.815363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.838285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1139/2290] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:43:14 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:14.842539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.852894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72ddd5-3977-4e85-92b0-79ba07c439ff admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.857898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.858539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.858834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.859106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.859917 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.861521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.873381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1152/2291] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:14.877676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.887879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137ad4-3187-4202-9778-0598e66db400 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:14.892909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:14.893810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:14.894097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:14.894368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] PATH_INFO: `/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0/users/278c72889337465daab66a3c0cc3e9d5/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:14.910785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b736b8a7bdf4415acc9bc40e89e2de0, user_id=278c72889337465daab66a3c0cc3e9d5, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:14.913481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:14.928666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1140/2292] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:43:14 2022] PUT /identity/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0/users/278c72889337465daab66a3c0cc3e9d5/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:43:14.932742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:14.943200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428cd09-ff5e-4713-9b84-03d88da670c3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:15.002100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:15.002663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:15.002944 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:15.003215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:15.003988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:15.005636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc75607-a77f-4bfe-884d-33a6cf9d5597 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:15.017336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1153/2293] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:15.022334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:15.034606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72004e3c-f117-45af-b6f9-28e85ff2d582 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:15.040383 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:15.041325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:15.041590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:15.041863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] PATH_INFO: `/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0/users/278c72889337465daab66a3c0cc3e9d5/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:15.044051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b736b8a7bdf4415acc9bc40e89e2de0, user_id=278c72889337465daab66a3c0cc3e9d5, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:15.046734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:15.057281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1141/2294] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:43:15 2022] PUT /identity/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0/users/278c72889337465daab66a3c0cc3e9d5/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:15.067794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:15.068084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:15.068476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:15.098245 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] MFA Rules not processed for user `278c72889337465daab66a3c0cc3e9d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:15.099527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:15.170380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1154/2295] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:15.184244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:15.186183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:15.245185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cd2e8-1522-481d-ba01-4e47e2b2536d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:15.250521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:15.251160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:15.251476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:15.251757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:15.315918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:15.317362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:15.326719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1142/2296] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:17.893134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:17.894802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:17.908040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f73f4a-d3b4-469f-b84a-c6bf4a1d698f None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:17.912622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:17.913384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:17.913684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:17.913954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:17.979007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:17.980521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:17.989632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1155/2297] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:18.610494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:18.620680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8173bb-43bc-4dad-b186-3a09fec76edf service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:18.625339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:18.626034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:18.626307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:18.626574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:18.636899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:18.638373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d07f07c-c14b-4fc5-9aeb-6946f9b093db service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:18.647612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1143/2298] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:43:22.553469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:22.620816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049aa69c-0608-4e04-a302-fa18dd962e32 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:22.626975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:22.627965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:22.628236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:22.628505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] PATH_INFO: `/v3/users/142c5717158c4adb86fa41f60fdd19c2` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:22.629818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] RBAC: Authorizing `identity:delete_user(user_id=142c5717158c4adb86fa41f60fdd19c2)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:22.631804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:22.687901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '142c5717158c4adb86fa41f60fdd19c2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:22.700978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '142c5717158c4adb86fa41f60fdd19c2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:22.707897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '142c5717158c4adb86fa41f60fdd19c2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:22.708638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '142c5717158c4adb86fa41f60fdd19c2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:22.717984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '142c5717158c4adb86fa41f60fdd19c2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:22.724218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1156/2299] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:22 2022] DELETE /identity/v3/users/142c5717158c4adb86fa41f60fdd19c2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:22.728781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:22.729310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:22.729310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:22.747637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:22.749023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:22.811166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1144/2300] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:22.821511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:22.823087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:22.887293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ded133-d9f9-477a-8554-9484c355873b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:22.891947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:22.892584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:22.892865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:22.893136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:22.903048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:22.904529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:22.914878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1157/2301] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:43:23.193761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:23.195230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:23.208088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cee4ab-6c18-4f49-a65f-8e14c973884d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:23.213417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:23.214380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:23.214647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:23.214964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] PATH_INFO: `/v3/projects/56821d90350f4533a74061979d24cae9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:23.216324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56821d90350f4533a74061979d24cae9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:23.218275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:23.267603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56821d90350f4533a74061979d24cae9', 'request_id': 'req-ccd04d9b-e1a1-48f1-b209-567a24bccf62'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.273444 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56821d90350f4533a74061979d24cae9', 'request_id': 'req-ccd04d9b-e1a1-48f1-b209-567a24bccf62'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.280375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56821d90350f4533a74061979d24cae9', 'request_id': 'req-ccd04d9b-e1a1-48f1-b209-567a24bccf62'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.294932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] The token cache is being invalidate because project 56821d90350f4533a74061979d24cae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:23.295224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.295937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.297513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1145/2302] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:23 2022] DELETE /identity/v3/projects/56821d90350f4533a74061979d24cae9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:43:23.301684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:23.311453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc488b-1816-4d4c-8320-643e32428f6f service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:23.372565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:23.373459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:23.373730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:23.373998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] PATH_INFO: `/v3/users/3b3061de1d8f477684c66f3eccff1f34` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:23.375406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b3061de1d8f477684c66f3eccff1f34)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:23.377650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:23.436345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b3061de1d8f477684c66f3eccff1f34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.453344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b3061de1d8f477684c66f3eccff1f34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.460315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b3061de1d8f477684c66f3eccff1f34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.461054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b3061de1d8f477684c66f3eccff1f34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.470048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b3061de1d8f477684c66f3eccff1f34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.476056 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1158/2303] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:23 2022] DELETE /identity/v3/users/3b3061de1d8f477684c66f3eccff1f34 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:23.750551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:23.752255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:23.767256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd04d9b-e1a1-48f1-b209-567a24bccf62 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:23.825194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:23.826415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:23.826687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:23.826952 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] PATH_INFO: `/v3/projects/bab66570cfe848a1a7122098ed74c790` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:23.828162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab66570cfe848a1a7122098ed74c790)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:23.830102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:23.878875 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab66570cfe848a1a7122098ed74c790', 'request_id': 'req-323441fd-b40e-47b1-90ba-fab64d2d1e41'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.884224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab66570cfe848a1a7122098ed74c790', 'request_id': 'req-323441fd-b40e-47b1-90ba-fab64d2d1e41'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.890564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab66570cfe848a1a7122098ed74c790', 'request_id': 'req-323441fd-b40e-47b1-90ba-fab64d2d1e41'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.907005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] The token cache is being invalidate because project bab66570cfe848a1a7122098ed74c790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:23.907289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.908269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:23.910094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1146/2304] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:23 2022] DELETE /identity/v3/projects/bab66570cfe848a1a7122098ed74c790 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:23.914232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:23.915810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:23.928962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60838c54-4350-4706-9628-a2c9b57dedde admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:23.989357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:23.990249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:23.990529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:23.990819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] PATH_INFO: `/v3/users/278c72889337465daab66a3c0cc3e9d5` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:23.992102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278c72889337465daab66a3c0cc3e9d5)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:23.994020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.045252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278c72889337465daab66a3c0cc3e9d5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.058208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278c72889337465daab66a3c0cc3e9d5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.066376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278c72889337465daab66a3c0cc3e9d5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.067498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278c72889337465daab66a3c0cc3e9d5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.077933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-182e971f-6bb0-407a-8924-d917dc3f2983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278c72889337465daab66a3c0cc3e9d5'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.084940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1159/2305] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:43:23 2022] DELETE /identity/v3/users/278c72889337465daab66a3c0cc3e9d5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:24.362583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.364085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:24.377068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323441fd-b40e-47b1-90ba-fab64d2d1e41 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.435088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.435942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.436242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.436525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] PATH_INFO: `/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.437877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b736b8a7bdf4415acc9bc40e89e2de0)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.439837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.488032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b736b8a7bdf4415acc9bc40e89e2de0', 'request_id': 'req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.493113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b736b8a7bdf4415acc9bc40e89e2de0', 'request_id': 'req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.498908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b736b8a7bdf4415acc9bc40e89e2de0', 'request_id': 'req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.519131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] The token cache is being invalidate because project 9b736b8a7bdf4415acc9bc40e89e2de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:43:24.519457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.520150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4a1c8e15-bf41-4596-8be9-1fb27dc9e352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:43:24.521845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1147/2306] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:43:24 2022] DELETE /identity/v3/projects/9b736b8a7bdf4415acc9bc40e89e2de0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:24.526839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.527157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.527443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.546833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:24.548036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:24.609569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1160/2307] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:24.618544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.618975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.619351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.639360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:24.640606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:24.650345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1148/2308] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:24.654457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.666502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20d0e-2f63-4993-8d23-24c66d28e202 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.672415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.673239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.673401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.673582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.674312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:43:24.674648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.676354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.691054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1161/2309] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:43:24.695606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.705737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71426aed-bef2-4fba-a45c-d967a179aa39 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.711361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.712056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.712332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.712600 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.713298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.715223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.742704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1149/2310] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:43:24 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:24.747064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.757782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44137f5-15e3-4df3-8b0e-dded0b2a2713 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.821579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.822259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.822538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.822817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.823549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.825847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.849599 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1162/2311] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:43:24 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:43:24.854078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.865349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d83d1-cd20-464f-a6ad-4e361a0ec65c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.871134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.871847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.872145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.872442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.873220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.874861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.885906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1150/2312] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:24.890047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.901093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbf273-5fcb-4e4c-b81d-4ea03d9f8eac admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.908497 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.909188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.909618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.909980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.910837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.912849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5586f-6648-4299-8170-b5715778e180 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.924621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1163/2313] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:43:24.928717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:24.939098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd20e0-fef8-4c57-801a-28eed545a95f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:24.944120 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:24.944951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.945258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.945552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] PATH_INFO: `/v3/projects/07fc5017912c4265b6baf1c9eb0fe507/users/1c3e2d28f8384b75b78c16f97dce1c98/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:24.962302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07fc5017912c4265b6baf1c9eb0fe507, user_id=1c3e2d28f8384b75b78c16f97dce1c98, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:24.964989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:24.977749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1151/2314] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:43:24 2022] PUT /identity/v3/projects/07fc5017912c4265b6baf1c9eb0fe507/users/1c3e2d28f8384b75b78c16f97dce1c98/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:43:24.983724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d199-bd69-4b6b-8001-29f8ba8673c1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:24.983970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d199-bd69-4b6b-8001-29f8ba8673c1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:24.984268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec28d199-bd69-4b6b-8001-29f8ba8673c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:25.002514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ec28d199-bd69-4b6b-8001-29f8ba8673c1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:25.003735 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ec28d199-bd69-4b6b-8001-29f8ba8673c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:25.063888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1164/2315] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:43:25.073728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:25.075882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:25.131710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d594faad-e1b0-42a7-a81c-b0c1e350c0c8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:25.135728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:25.136380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:25.136657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:25.136936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:25.146057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:25.147521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:25.156769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1152/2316] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:43:25.763285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b30df-9a26-4ff9-bb53-6a1411aed354 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:25.763673 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b30df-9a26-4ff9-bb53-6a1411aed354 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:25.764015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b30df-9a26-4ff9-bb53-6a1411aed354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:25.790970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f01b30df-9a26-4ff9-bb53-6a1411aed354 None None] MFA Rules not processed for user `1c3e2d28f8384b75b78c16f97dce1c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:25.792382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f01b30df-9a26-4ff9-bb53-6a1411aed354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:25.855737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1165/2317] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:25.867288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:43:25.868958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:25.925619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f0ee1-eea0-4e3e-80be-2fd214e9d43d service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:43:25.932924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:43:25.933673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:25.933953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:25.934288 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:25.944157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:43:25.945606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e296a8-1bfe-42fe-95b9-add1faf4b9c2 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:43:25.956113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1153/2318] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:43:28.378829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018b37-08de-4a8b-b01d-a7bf42bfd365 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:28.379328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018b37-08de-4a8b-b01d-a7bf42bfd365 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:28.379449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018b37-08de-4a8b-b01d-a7bf42bfd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:28.397751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5c018b37-08de-4a8b-b01d-a7bf42bfd365 None None] MFA Rules not processed for user `1c3e2d28f8384b75b78c16f97dce1c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:28.398960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5c018b37-08de-4a8b-b01d-a7bf42bfd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:28.406427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1166/2319] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:32.075826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:32.076394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:32.076394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:32.103163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] MFA Rules not processed for user `4659bfb748294775b81b1dff3e77c5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:32.104403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:32.161691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1154/2320] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:43:47.786620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041138a6-62dc-4aa8-9e89-fc1a4bd6bafa None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:43:47.787208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041138a6-62dc-4aa8-9e89-fc1a4bd6bafa None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:43:47.787208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041138a6-62dc-4aa8-9e89-fc1a4bd6bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:43:47.808712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-041138a6-62dc-4aa8-9e89-fc1a4bd6bafa None None] MFA Rules not processed for user `1c3e2d28f8384b75b78c16f97dce1c98`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:43:47.809984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-041138a6-62dc-4aa8-9e89-fc1a4bd6bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:43:47.819031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1167/2321] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:14.399227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:14.409038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b06f0a-4a94-4824-8b8e-0e021ac924cb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:14.412817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:14.413457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:14.413737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:14.414008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:14.415810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:14.483927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:14.485389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:14.495871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1155/2322] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:34.428066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607098a-ef83-4ca9-8eb2-93655e15032b None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:34.428589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607098a-ef83-4ca9-8eb2-93655e15032b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:34.428589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607098a-ef83-4ca9-8eb2-93655e15032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:34.487538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8607098a-ef83-4ca9-8eb2-93655e15032b None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:34.488793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8607098a-ef83-4ca9-8eb2-93655e15032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:34.564458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1168/2323] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:44:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:44:34.622783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:34.624294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:34.717365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16efe29-0f38-487d-afac-277215839934 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:34.722812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:34.723493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:34.723770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:34.724058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:34.732787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:34.734380 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:34.742918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1156/2324] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:44:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:44:35.895731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1264-f25f-45e4-ae20-a2e1de9b4e0f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:35.896442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1264-f25f-45e4-ae20-a2e1de9b4e0f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:35.896442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c1264-f25f-45e4-ae20-a2e1de9b4e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:35.915964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-815c1264-f25f-45e4-ae20-a2e1de9b4e0f None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:35.917119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-815c1264-f25f-45e4-ae20-a2e1de9b4e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:35.924742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1169/2325] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:35.940619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:35.952721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2607-3b83-4c28-9ec0-fc7142967f0d service swift] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:35.958411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:35.959180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:35.959552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:35.959833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:35.970131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:35.971896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e09db-b91c-425d-8db6-7fb74addec3a service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:35.982390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1157/2326] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:44:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:44:48.769783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:48.770395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:48.770395 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:48.789500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] MFA Rules not processed for user `d08477bbef5144c7a0c685e938b78b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:48.790644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:48.853659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1170/2327] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:52.507233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:52.508186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:52.508655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:52.527634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:52.528827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:52.536238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1158/2328] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:44:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:52.551537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:52.563086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6c4d4-5c36-4e27-9e44-1e6a2a6f4993 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:52.568044 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:52.568682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:52.568985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:52.569261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:52.578058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:52.579671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:52.587698 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1171/2329] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:44:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:44:54.591532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:54.607410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31fb51a-ad66-4326-bac9-9d6a511f39c8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:54.612550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:54.613616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:54.613892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:54.614164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] PATH_INFO: `/v3/users/1c3e2d28f8384b75b78c16f97dce1c98` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:54.615351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3e2d28f8384b75b78c16f97dce1c98)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:54.617303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:54.666453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3e2d28f8384b75b78c16f97dce1c98'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:54.674103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3e2d28f8384b75b78c16f97dce1c98'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:54.687100 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3e2d28f8384b75b78c16f97dce1c98'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:54.687842 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3e2d28f8384b75b78c16f97dce1c98'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:54.696015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-36840a4d-6764-4f50-a541-03f04bf81ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3e2d28f8384b75b78c16f97dce1c98'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:54.702358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1159/2330] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:44:54 2022] DELETE /identity/v3/users/1c3e2d28f8384b75b78c16f97dce1c98 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:44:54.892929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:54.905432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fb6f2-b2e1-48ec-b2de-1e01b17ace89 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:54.975755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:54.976628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:54.977043 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:54.977324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] PATH_INFO: `/v3/projects/07fc5017912c4265b6baf1c9eb0fe507` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:54.978523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=07fc5017912c4265b6baf1c9eb0fe507)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:54.980536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.027687 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07fc5017912c4265b6baf1c9eb0fe507', 'request_id': 'req-9aab139a-b735-4c2c-add6-1b4055b18d5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:55.033471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07fc5017912c4265b6baf1c9eb0fe507', 'request_id': 'req-9aab139a-b735-4c2c-add6-1b4055b18d5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:55.040001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07fc5017912c4265b6baf1c9eb0fe507', 'request_id': 'req-9aab139a-b735-4c2c-add6-1b4055b18d5c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:55.052697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] The token cache is being invalidate because project 07fc5017912c4265b6baf1c9eb0fe507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:44:55.052988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:55.053609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9aab139a-b735-4c2c-add6-1b4055b18d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:44:55.055125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1172/2331] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:44:54 2022] DELETE /identity/v3/projects/07fc5017912c4265b6baf1c9eb0fe507 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:44:55.060378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.060727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.061067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.080175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.081359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.140838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1160/2332] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:44:55.148835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca99ee-8287-4ccd-96e3-aa105bd8c508 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.149266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca99ee-8287-4ccd-96e3-aa105bd8c508 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.149666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca99ee-8287-4ccd-96e3-aa105bd8c508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.168596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-72ca99ee-8287-4ccd-96e3-aa105bd8c508 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.169899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-72ca99ee-8287-4ccd-96e3-aa105bd8c508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.178253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1173/2333] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:44:55.182835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.197236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc834f-eb80-469a-8abf-35467d99b41f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.202539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.203209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.203520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.203794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.205245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:44:55.205551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.207151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.227834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b05a89-027b-4f94-a923-7cfd66e88b73 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.228363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b05a89-027b-4f94-a923-7cfd66e88b73 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.228788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b05a89-027b-4f94-a923-7cfd66e88b73 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.232656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1161/2334] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:44:55.233812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1174/2335] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:44:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:55.236687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.240228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.240752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.241092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.250197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494da424-f451-40c6-8468-47de425aa77b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.260452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.261184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.261589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.261947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.263082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.265320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.286174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.287717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.296405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1162/2336] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:44:55.297659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.363019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1175/2337] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:55.375699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.377308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.389196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09429f65-a9d5-4e82-8593-82816eb19f3a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.394661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.395337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.395665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.395925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.396787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.398811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.420334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1163/2338] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:44:55.423558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.434136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1891f05-2ade-48bc-839f-d94d1b1f0315 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.438882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.439634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.440041 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.440375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.441162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.442841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.453861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1164/2339] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:44:55.457487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.459583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0436d-ff55-4402-8d86-8c8f37141a09 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.468659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5721-7fe2-4a6c-a9ba-79865352f9d6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.473398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.474147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.474422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.474690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.475425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.477151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.491852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1165/2340] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:44:55.496032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.505917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1230b832-43af-4ed7-a9c7-b1a4c3291cd3 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.516091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.516745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.516995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.517274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.517673 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.518561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.518832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.519105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] PATH_INFO: `/v3/projects/9ce07a6d9c3449cf828cec61015b7d4d/users/46df371840594bf5b018e8864be8364f/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.533805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ce07a6d9c3449cf828cec61015b7d4d, user_id=46df371840594bf5b018e8864be8364f, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.536510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9f9b1-40f9-43e0-9ffb-e4866aa13d31 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.549738 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1166/2341] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:44:55 2022] PUT /identity/v3/projects/9ce07a6d9c3449cf828cec61015b7d4d/users/46df371840594bf5b018e8864be8364f/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:44:55.564262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.564262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.564262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.583756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.585193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef2609-44fb-4771-9402-b8830fd5d2d8 service glance] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.587462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] MFA Rules not processed for user `46df371840594bf5b018e8864be8364f`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.588646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.596028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1176/2342] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:44:55.651860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1167/2343] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:44:55.663286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ea96-1a5c-46d8-b848-3e47b00adc98 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.663697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ea96-1a5c-46d8-b848-3e47b00adc98 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.663964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.664081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ea96-1a5c-46d8-b848-3e47b00adc98 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.665490 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1177/2344] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:55.670152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e4aa-1413-4bc2-88f0-b785ef2cfe6b None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.670436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e4aa-1413-4bc2-88f0-b785ef2cfe6b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.670714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e4aa-1413-4bc2-88f0-b785ef2cfe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.688596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-86d8e4aa-1413-4bc2-88f0-b785ef2cfe6b None None] MFA Rules not processed for user `a3aa6a22bd7c49679c84f824f43aca30`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.689796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-86d8e4aa-1413-4bc2-88f0-b785ef2cfe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.721241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee25e32-828d-4766-9fba-37b3cedc3147 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.725323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.726014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.726267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.726572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.735485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.736897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.747013 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1168/2345] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:44:55.748655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1178/2346] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:44:55.760961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:55.762486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.777439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ffea5-79da-49b7-a96f-b5fe203ddc2d service glance] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:55.781285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:55.781927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.782210 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.782485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.789597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:55.791010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32122ff1-ab47-4565-ad1b-d911368676c0 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:55.798674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1169/2347] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:44:55.885279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e048-b869-48d0-8fd2-36f2b58400f7 None None] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.885616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e048-b869-48d0-8fd2-36f2b58400f7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.885966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753e048-b869-48d0-8fd2-36f2b58400f7 None None] PATH_INFO: `/` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.887604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1179/2348] 10.222.0.23 () {54 vars in 921 bytes} [Wed May 4 21:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 04 21:44:55.892995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:55.893310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:55.893588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:55.912336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] MFA Rules not processed for user `0916e52c6c48499588ca68d970588ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:44:55.913819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:55.979841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1170/2349] 10.222.0.23 () {58 vars in 1018 bytes} [Wed May 4 21:44:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:44:55.990746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e048-b869-48d0-8fd2-36f2b58400f7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:56.001978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753e048-b869-48d0-8fd2-36f2b58400f7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:56.006526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:56.007271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:56.007665 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:56.008031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:56.018786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:56.020389 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:56.032330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1180/2350] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:44:58.470826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:44:58.472505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:58.484107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896ecf7-c808-426b-b026-08c42bbf4ed8 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:44:58.488289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:44:58.488948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:44:58.489229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:44:58.489502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:44:58.491538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:44:58.505945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:44:58.507471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795a630-3f11-4129-9da5-40c89da770d7 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:44:58.518812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1171/2351] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:45:00.027699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:00.036719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2635-dd36-42ea-a619-9e3fba522544 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:00.040697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:00.041319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:00.041593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:00.041867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:00.044109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:00.058654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:00.060198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:00.071168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1181/2352] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:45:04.301110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:04.301656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:04.301656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:04.320866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:45:04.322324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:04.380417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1172/2353] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:45:04.393076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:04.394662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:04.466795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f353f3e-a065-46d0-9940-bd4e432b37cd service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:04.473062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:04.473754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:04.474086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:04.474354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:04.482920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:04.484574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:04.493037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1182/2354] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:45:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:45:13.114433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:13.116571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:13.141057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf09132-214b-40d2-bfbd-a10f59826adf None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:13.150354 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:13.150999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:13.151283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:13.151620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:13.153654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:13.215515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:13.217119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a76452-1ce5-4b48-9be3-07549d01ee1b service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:13.227124 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1173/2355] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:45:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:45:43.477800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:43.544728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e38e4-2708-431b-b806-53965c41deb0 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:43.549943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:43.550817 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:43.551090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:43.551392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] PATH_INFO: `/v3/users/46df371840594bf5b018e8864be8364f` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:43.552586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46df371840594bf5b018e8864be8364f)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:43.554503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:43.603428 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46df371840594bf5b018e8864be8364f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:43.614826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46df371840594bf5b018e8864be8364f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:43.621925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46df371840594bf5b018e8864be8364f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:43.622564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46df371840594bf5b018e8864be8364f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:43.631886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46df371840594bf5b018e8864be8364f'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:43.638141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1183/2356] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:45:43 2022] DELETE /identity/v3/users/46df371840594bf5b018e8864be8364f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:45:43.642882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:43.643422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:43.643520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:43.661971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:45:43.663154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:43.725720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1174/2357] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:45:43.736160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:43.738451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:43.806263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b78d0-63a3-457d-9b9d-2dcb07050f89 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:43.812939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:43.813792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:43.814127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:43.814449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:43.829512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:43.830949 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:43.840804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1184/2358] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:45:44.107933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:44.109771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:44.131462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63466bf-1bc6-464d-b1e1-3d7ec396257f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:44.131462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:44.131462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:44.131462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:44.131855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] PATH_INFO: `/v3/projects/9ce07a6d9c3449cf828cec61015b7d4d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:44.131855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ce07a6d9c3449cf828cec61015b7d4d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:44.132362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:44.177953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ce07a6d9c3449cf828cec61015b7d4d', 'request_id': 'req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:44.183064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ce07a6d9c3449cf828cec61015b7d4d', 'request_id': 'req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:44.189056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ce07a6d9c3449cf828cec61015b7d4d', 'request_id': 'req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:44.204727 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] The token cache is being invalidate because project 9ce07a6d9c3449cf828cec61015b7d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:45:44.205099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:44.206134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:45:44.208652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1175/2359] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:45:44 2022] DELETE /identity/v3/projects/9ce07a6d9c3449cf828cec61015b7d4d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:45:54.603679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:54.605791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:54.681846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4634cc-8ec8-42e5-a3f7-04845c70f88d service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:54.743956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:54.744615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:54.744897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:54.745172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:54.747040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:54.802955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:54.804586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:54.813833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1185/2360] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:45:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:45:59.233264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:45:59.235110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:59.254914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c250c-2f85-4ff2-b6f6-c7f07b8b1ef9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:45:59.258843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:45:59.259663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:45:59.259954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:45:59.260224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:45:59.262186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:45:59.277937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:45:59.281560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce91f27-a9d3-40b5-b5c1-14c30bd0b701 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:45:59.294862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1176/2361] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:45:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:00.702844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:00.704432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:00.761788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a62ee6f-f9a1-442a-bf2d-ab44d230616d service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:00.766866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:00.767556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:00.767834 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:00.768101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:00.770319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:00.780390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:00.781818 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:00.790308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1186/2362] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:08.548806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:08.549303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:08.549401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:08.570920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:08.571613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:08.626943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1177/2363] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:46:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:08.668796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:08.670434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:08.741314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7bf85-ab97-4f0a-9889-842ff2c548c6 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:08.747531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:08.748158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:08.748485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:08.748664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:08.756994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:08.758574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:08.766479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1187/2364] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:46:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:46:16.423851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:16.437047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290c5e6-eba7-4aa4-85e5-0c346b47b03a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:16.442471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:16.443117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:16.443424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:16.444010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:16.445786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:16.458582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:16.460193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370e352-86c5-4a46-959c-d293ce5964ec service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:16.470803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1178/2365] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:30.724832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:30.738281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c166f5b-1578-4896-bdaa-76194fbb3bf0 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:30.745561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:30.746192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:30.746468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:30.746715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:30.749036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:30.806820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:30.808419 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:30.817618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1188/2366] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:40.607837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:40.608396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:40.608528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:40.627990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] MFA Rules not processed for user `c9109b244aef49a1a29050bb055c0ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:40.629235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:40.636220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1179/2367] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:43.366958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.368488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.441014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcbc1d2-a9a4-43c8-a862-abf42143088c service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:43.446209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:43.447108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.447431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.447678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] PATH_INFO: `/v3/users/d08477bbef5144c7a0c685e938b78b92` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.448922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08477bbef5144c7a0c685e938b78b92)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:43.450859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:43.511321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08477bbef5144c7a0c685e938b78b92'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.522589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08477bbef5144c7a0c685e938b78b92'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.529878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08477bbef5144c7a0c685e938b78b92'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.530840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08477bbef5144c7a0c685e938b78b92'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.540171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d3fc6c6a-ffd1-4ac0-8e22-ba23a9db16f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08477bbef5144c7a0c685e938b78b92'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.546115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1189/2368] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:46:43 2022] DELETE /identity/v3/users/d08477bbef5144c7a0c685e938b78b92 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:43.720745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:43.732896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f148f0-7b9f-47cf-bf52-7eedebee1a34 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:43.810005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:43.810780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.811055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.811323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] PATH_INFO: `/v3/projects/7898995e41684b029b6370132bc5d1ac` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.812810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7898995e41684b029b6370132bc5d1ac)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:43.814711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:43.864810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7898995e41684b029b6370132bc5d1ac', 'request_id': 'req-035dac6e-6218-41d6-9077-03c417125965'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.870184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7898995e41684b029b6370132bc5d1ac', 'request_id': 'req-035dac6e-6218-41d6-9077-03c417125965'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.876447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7898995e41684b029b6370132bc5d1ac', 'request_id': 'req-035dac6e-6218-41d6-9077-03c417125965'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.890324 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] The token cache is being invalidate because project 7898995e41684b029b6370132bc5d1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:46:43.890607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.891211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-035dac6e-6218-41d6-9077-03c417125965 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:46:43.892762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1180/2369] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:46:43 2022] DELETE /identity/v3/projects/7898995e41684b029b6370132bc5d1ac => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:43.898730 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.899114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.899541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:43.919675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:43.921010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:43.984724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1190/2370] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:43.993376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:43.993691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:43.994043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.014261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:44.015597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.025127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1181/2371] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:44.030582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.040551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05012990-daa8-44fb-99bb-d9974ff90b12 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.046222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.046871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.047151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.047483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.048201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:46:44.048508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.050121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.061884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1191/2372] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:46:44.066235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.076006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707542c-ab23-4a67-8d7f-7a76ad12d06b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.080935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.081568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.081894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.082157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.082849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.084757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.123429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1182/2373] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:46:44 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:44.127872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.140362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c7f5b-171b-40cc-b34a-50f15dc62287 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.201671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.202457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.202761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.203023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.203746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.205651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.225759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1192/2374] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:46:44 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:44.232715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.243035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d29549-0aa6-4b9d-bbbd-eeac7a8152bf admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.248137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.248794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.249070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.249342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.250067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.251708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.262501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1183/2375] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:44.268477 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.283430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cfc60-57cb-495d-a5db-c1a91b89b53e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.290606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.291703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.292156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.292585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.293921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.295568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8268fa-d5b4-4789-af19-cd368ab65f9f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.306134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1193/2376] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:44.312285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.325530 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44726a7-aa0f-48d5-9a1a-c186c5c6ab6a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.330139 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.331033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.331309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.331627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] PATH_INFO: `/v3/projects/9b8ef92f23d84056b1d9aaf209751e94/users/29753f533caa4371a7ff36514149438c/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.347196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8ef92f23d84056b1d9aaf209751e94, user_id=29753f533caa4371a7ff36514149438c, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.349856 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.366046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1184/2377] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:46:44 2022] PUT /identity/v3/projects/9b8ef92f23d84056b1d9aaf209751e94/users/29753f533caa4371a7ff36514149438c/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:44.372098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2479-74a9-4432-a19d-3150b0764366 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.372675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2479-74a9-4432-a19d-3150b0764366 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.372675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db2479-74a9-4432-a19d-3150b0764366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.390380 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-01db2479-74a9-4432-a19d-3150b0764366 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:44.391605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-01db2479-74a9-4432-a19d-3150b0764366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.461451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1194/2378] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:44.473533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:44.474925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:44.533706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23346152-ea47-4389-a3af-9c99457fa3ae admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:44.537230 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:44.537874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:44.538155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:44.538424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:44.547338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:44.548784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:44.558215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1185/2379] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:49.475211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.475855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.475855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.503511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] MFA Rules not processed for user `29753f533caa4371a7ff36514149438c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:49.504722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:49.581426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1195/2380] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:49.585831 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.595641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b997837-60e0-4e43-bf12-bfa9e7daee10 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.600229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.601212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.601490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.601936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.602898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.605030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.637358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1186/2381] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:49.641426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.657260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b465cf-2749-42e3-b392-9db6ea18dcd5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.733483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.734331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.734777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.735095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.735869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.737887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.769726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1196/2382] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:46:49 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:46:49.773390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.784323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b6df1-68fe-4702-a64f-b38fb308b912 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.789112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.789913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.790268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.790631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.791723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.793527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.805340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1187/2383] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:49.809538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.821015 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e299b8-5e13-4743-a76b-60efaa264bd8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.827349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.829251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.830445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.830445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] PATH_INFO: `/v3/projects/bbc62504ac9f4491a641614c5a1fddf3/users/7339d4da538d4533bc7c3fd5e4177b4a/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.847312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc62504ac9f4491a641614c5a1fddf3, user_id=7339d4da538d4533bc7c3fd5e4177b4a, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.849996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.864039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1197/2384] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:46:49 2022] PUT /identity/v3/projects/bbc62504ac9f4491a641614c5a1fddf3/users/7339d4da538d4533bc7c3fd5e4177b4a/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:49.867903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.879173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ed5ad-5b97-4174-a3dd-cf6330169bd1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.942643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.943492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.943855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.944237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.945579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.947818 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.959841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1188/2385] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:46:49.964290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:49.975071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009ad9e-c831-40d1-ab6e-ae3b424eeecf admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:49.980723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:49.981656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:49.981937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:49.982210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] PATH_INFO: `/v3/projects/bbc62504ac9f4491a641614c5a1fddf3/users/7339d4da538d4533bc7c3fd5e4177b4a/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:49.984237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc62504ac9f4491a641614c5a1fddf3, user_id=7339d4da538d4533bc7c3fd5e4177b4a, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:49.986902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05799975-1ef8-4c03-9892-1b48e8a0636f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:49.997706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1198/2386] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:46:49 2022] PUT /identity/v3/projects/bbc62504ac9f4491a641614c5a1fddf3/users/7339d4da538d4533bc7c3fd5e4177b4a/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:46:50.185975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:50.187807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.266349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d743a-3b2f-4753-9ece-4d8866975519 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:50.350785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:50.351517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:50.351993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:50.352277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:50.354919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:50.440476 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:50.443117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:50.454601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1189/2387] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:54.944844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b54-4140-4827-b724-ada1ac51775d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:54.945379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b54-4140-4827-b724-ada1ac51775d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:54.945379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c73b54-4140-4827-b724-ada1ac51775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:54.973501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-98c73b54-4140-4827-b724-ada1ac51775d None None] MFA Rules not processed for user `7339d4da538d4533bc7c3fd5e4177b4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:54.974628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-98c73b54-4140-4827-b724-ada1ac51775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.047744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1199/2388] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:55.060414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.061878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.140762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3c6db-41ff-44e5-b50c-0318c022b2ec service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.146085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.146772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.148308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.148308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.215227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.216806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.247616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1190/2389] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:46:55.354381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd840c68-f6c4-4a31-89ce-1d7f5c5ccf1f None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.354674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd840c68-f6c4-4a31-89ce-1d7f5c5ccf1f None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.354954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd840c68-f6c4-4a31-89ce-1d7f5c5ccf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.373894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-bd840c68-f6c4-4a31-89ce-1d7f5c5ccf1f None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:46:55.375107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bd840c68-f6c4-4a31-89ce-1d7f5c5ccf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.440441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1200/2390] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:46:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:46:55.454115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:46:55.455670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:46:55.539239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80abbec-90fc-449d-9d88-b44ed133e1c8 service glance] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:46:55.546129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:46:55.546794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:46:55.547069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:46:55.547446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:46:55.556173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:46:55.557921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:46:55.567213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1191/2391] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:46:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:47:05.059490 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.059985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.059985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.077899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] MFA Rules not processed for user `29753f533caa4371a7ff36514149438c`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:05.079078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.086402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1201/2392] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:47:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:05.347803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.403544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7264ea-39f3-4d29-8e71-93082f20fda8 service swift] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.407707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.408338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.408616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.408885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.410770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.421085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.422492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404db4b-0413-4111-a27a-35a76fa9e7e3 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.431023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1192/2393] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:05.741052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:05.742604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.815029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510af93-5624-4aa2-aca1-7ef087e04510 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:05.820697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:05.821347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:05.821628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:05.821901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:05.823946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:05.834995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:05.836628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:05.846058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1202/2394] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:07.775902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.776428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.776428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.815620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:07.817329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.851786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1193/2395] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:47:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:07.859978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.874033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25bab4-42e7-4581-a542-3794d3140032 service placement] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.882058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.882962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.883243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.883549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.887747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:07.889353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.896878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.898699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb06ab74-d0ce-42ef-891e-e02fc9ef6c92 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.903913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449ed66-7b2c-42f0-9311-c37b1a4062f5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:07.908682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:07.909621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:07.910101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:07.910496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:07.913612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:07.914601 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1203/2396] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 04 21:47:07.933381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:07.934981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:07.944839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1194/2397] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:47:37.599689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:37.600267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:37.600267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:37.618753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] MFA Rules not processed for user `4b47d6eb074c484d8d8dd5552783d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:47:37.620040 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:37.678632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1204/2398] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:47:40.704454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:40.713529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50c753-3904-47be-995b-a8dfb387b258 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:40.718064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:40.718941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:40.719216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:40.719520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:40.729591 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:40.731029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:40.741009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1195/2399] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:42.505888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:42.508587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:42.528410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a78c3e-4134-4a9e-99a9-e9b0c4421615 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:42.534700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:42.535690 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:42.536388 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:42.536885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:42.538888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:42.552902 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:42.554705 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cb3a2f-6637-4ff8-ba08-7cc1a4d8c54d service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:42.567019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1205/2400] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:47:59.636796 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:47:59.649641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406d54-15c3-4434-b686-88227c8efb21 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:47:59.656589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:47:59.657215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:47:59.657496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:47:59.657765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:47:59.659691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:47:59.727988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:47:59.729571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:47:59.738794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1196/2401] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:47:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:02.010281 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:02.010857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:02.010857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:02.030111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] MFA Rules not processed for user `4659bfb748294775b81b1dff3e77c5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:02.031548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:02.039662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1206/2402] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:09.381948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:09.393584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e9454-0fbd-4c4c-ba4f-11b3abdad212 service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:09.400024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:09.400762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:09.401038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:09.401310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:09.403510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:09.415807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:09.417432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:09.428181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1197/2403] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:12.717886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:12.728552 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be2497-b826-45a5-8a05-c85c2a5390aa None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:12.732793 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:12.733427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:12.733709 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:12.733981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:12.735964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:12.805575 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:12.807018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:12.817480 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1207/2404] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:16.905967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:16.907487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:16.921756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250745a-1b06-4d66-b1e3-3b540528203f service placement] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:16.926610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:16.927520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:16.927833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:16.928105 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] PATH_INFO: `/v3/users/c9109b244aef49a1a29050bb055c0ba2` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:16.929367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9109b244aef49a1a29050bb055c0ba2)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:16.931317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:16.981730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9109b244aef49a1a29050bb055c0ba2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:16.988728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9109b244aef49a1a29050bb055c0ba2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.000838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9109b244aef49a1a29050bb055c0ba2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.001560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9109b244aef49a1a29050bb055c0ba2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.010095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6ffc9624-1b9d-4b3e-a3e1-001f6b8c65ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9109b244aef49a1a29050bb055c0ba2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.016049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1198/2405] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:16 2022] DELETE /identity/v3/users/c9109b244aef49a1a29050bb055c0ba2 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:17.270794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.284225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642a33-203d-4886-b498-29480423f47e service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.341864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.342696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.342997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.343264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] PATH_INFO: `/v3/projects/3b05fdea4cf3422d991c8cb98cafe373` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.344614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b05fdea4cf3422d991c8cb98cafe373)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.346578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.394781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b05fdea4cf3422d991c8cb98cafe373', 'request_id': 'req-a925dd59-f98b-405c-b5b7-1725e41025fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.400031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b05fdea4cf3422d991c8cb98cafe373', 'request_id': 'req-a925dd59-f98b-405c-b5b7-1725e41025fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.406033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b05fdea4cf3422d991c8cb98cafe373', 'request_id': 'req-a925dd59-f98b-405c-b5b7-1725e41025fd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.419904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] The token cache is being invalidate because project 3b05fdea4cf3422d991c8cb98cafe373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:17.420273 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.420946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a925dd59-f98b-405c-b5b7-1725e41025fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:17.422587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1208/2406] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:17 2022] DELETE /identity/v3/projects/3b05fdea4cf3422d991c8cb98cafe373 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:17.428203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.428556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.428993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.449442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:17.450648 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.505913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1199/2407] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:17.515142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.515558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.515986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.538385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:17.539610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.548336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1209/2408] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:17.552385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.561825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a125c2b5-2e9d-4623-93be-26ae38f5e967 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.567163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.567859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.568132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.568403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.569133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:17.569433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.571027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.582114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1200/2409] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:17.586267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.595302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724aeb2f-ed83-489c-8d55-f84baf5b3dae None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.600539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.601169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.601444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.601716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.602392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.604322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.632798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1210/2410] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:48:17.638914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.653300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b606e-93f5-4951-b233-135ef6166463 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.722799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.723497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.723777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.724044 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.724723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.726702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.753517 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1201/2411] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:17.759857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.776095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1aeb-1f78-4733-802b-80f51242f314 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.783325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.784039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.784317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.784585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.785326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.787927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.799346 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1211/2412] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:17.803579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.814651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f801310-07d8-475f-a614-8de72de6c8c9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.820906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.821558 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.821839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.822133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.822829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.824532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21160b9a-e827-4946-8cbc-2fca6e1594e3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.835647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1202/2413] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:17.839985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:17.850489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb59b2-95ed-4942-8585-80ff4e8cce5a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:17.855471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:17.856366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.856640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.856908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] PATH_INFO: `/v3/projects/ef16b735eecc4151a0fcf364aaef50cd/users/611b6545890d4591811d6651f94c5934/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.873099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef16b735eecc4151a0fcf364aaef50cd, user_id=611b6545890d4591811d6651f94c5934, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:17.875788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:17.890192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1212/2414] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:17 2022] PUT /identity/v3/projects/ef16b735eecc4151a0fcf364aaef50cd/users/611b6545890d4591811d6651f94c5934/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:17.900498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:17.900805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:17.901102 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:17.928543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] MFA Rules not processed for user `611b6545890d4591811d6651f94c5934`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:17.929750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:17.996112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1203/2415] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:18.007374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:18.009208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:18.093243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ad611-991f-46a3-becb-4686ceffae03 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:18.100470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:18.101156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:18.101589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:18.101994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:18.110753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:18.112410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6608cd-c45c-48c5-8a47-ef7afccf3102 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:18.126664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1213/2416] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:20.833299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:20.897468 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ccc2e-2c96-4d1c-b57b-58a08d09ddd1 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:20.902067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:20.902963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:20.903337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:20.903637 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] PATH_INFO: `/v3/users/611b6545890d4591811d6651f94c5934` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:20.904823 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=611b6545890d4591811d6651f94c5934)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:20.906720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:20.954799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611b6545890d4591811d6651f94c5934'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.961544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611b6545890d4591811d6651f94c5934'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.973700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611b6545890d4591811d6651f94c5934'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.974420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611b6545890d4591811d6651f94c5934'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.982255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611b6545890d4591811d6651f94c5934'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:20.988431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1204/2417] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:20 2022] DELETE /identity/v3/users/611b6545890d4591811d6651f94c5934 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:20.993303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:20.993781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:20.994033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.011847 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:21.013032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.073102 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1214/2418] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:21.082716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.084199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.140848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213de154-f2b4-44bc-b74a-c0bfb98fb38a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.144557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.145397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.145674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.145945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.155063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.156610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a450d-40c2-4902-a358-1e2e1a4c45e5 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.166104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1205/2419] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:21.444190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.445711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.458485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d130-79b9-4727-97e3-1c5194589584 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.464224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.465222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.465871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.465871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] PATH_INFO: `/v3/projects/ef16b735eecc4151a0fcf364aaef50cd` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.467365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef16b735eecc4151a0fcf364aaef50cd)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.469549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.520586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef16b735eecc4151a0fcf364aaef50cd', 'request_id': 'req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.526613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef16b735eecc4151a0fcf364aaef50cd', 'request_id': 'req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.534004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef16b735eecc4151a0fcf364aaef50cd', 'request_id': 'req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.547437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] The token cache is being invalidate because project ef16b735eecc4151a0fcf364aaef50cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:21.547774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.548333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ba52b00c-2fcf-4cba-a6ad-73b999a6649b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:21.553246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1215/2420] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:21 2022] DELETE /identity/v3/projects/ef16b735eecc4151a0fcf364aaef50cd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:21.554971 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.555271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.555616 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.573202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:21.574389 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.631629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1206/2421] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:21.640502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.640790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.641100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.659317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:21.660527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:21.669342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1216/2422] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:21.673636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.683190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc99b-93a9-4823-a840-9370f17c1607 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.688407 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.689054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.689326 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.689595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.690311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:21.690608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.692234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.705133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1207/2423] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:21.709361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.718307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae04503-0a84-49f1-9336-ab4402cb3257 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.722932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.723618 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.723893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.724161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.724842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.726765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.755900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1217/2424] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:21.757143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.767232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a615094-f837-4e3d-bfef-e216c248643b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.826181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.826860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.827136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.827465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.828198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.830174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.852359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1208/2425] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:21.856600 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.867468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89efb1-1835-42f6-bf4d-d0b4586dcd36 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.873656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.874319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.874594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.874860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.875633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.877237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.887644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1218/2426] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:21.891689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.902099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413a84b-5364-44d1-a0ef-03b754e51927 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.907560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.908222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.908505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.908775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.909500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.911131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40265cf-599f-4d13-a1f3-c72fa5bbf287 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.921267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1209/2427] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:21.926318 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:21.936411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15323c5-2d1b-40fe-972d-b46260864148 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:21.941503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:21.942487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.942827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.943103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] PATH_INFO: `/v3/projects/d020faa7f19a4087815bd3947e5ff725/users/a5fb6c29630046fe8497b43c387ed439/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:21.957594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d020faa7f19a4087815bd3947e5ff725, user_id=a5fb6c29630046fe8497b43c387ed439, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:21.960267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:21.974809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1219/2428] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:21 2022] PUT /identity/v3/projects/d020faa7f19a4087815bd3947e5ff725/users/a5fb6c29630046fe8497b43c387ed439/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:21.985412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:21.985703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:21.986666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.013889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] MFA Rules not processed for user `a5fb6c29630046fe8497b43c387ed439`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:22.015148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.081906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1210/2429] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:22.086505 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.149783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27175855-bfae-48b8-95a0-c83676bc6fcf admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.154589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.155258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.155592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.155873 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.156558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.158527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.185676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1220/2430] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:22.190215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.207016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1314e4-3c84-4bed-9437-1ca62a6bae5f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.272267 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.272950 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.273227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.273536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.274184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.276243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.298112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1211/2431] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:22.299500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.309646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c1859-fd10-4c91-9029-6c51f9b9bb42 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.314551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.315218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.315546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.315819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.316546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.318147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.329041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1221/2432] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:22.333092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.343342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973182fd-d256-4b0e-aa06-636486e6e98d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.349185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.349859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.350140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.350409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.351132 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.352751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c102b-d76a-4b69-86ef-81933dcd0919 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.366085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1212/2433] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:22.367682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.378716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f14266-b4f4-4fe6-8627-d92b2e023aad admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.384742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.385689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.385966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.386240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] PATH_INFO: `/v3/projects/5c965248b9ca4c14a93330337c5102bc/users/0457ac0166ba4adca55b6443bfbeeca9/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.400883 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c965248b9ca4c14a93330337c5102bc, user_id=0457ac0166ba4adca55b6443bfbeeca9, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.403581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.419780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1222/2434] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:22 2022] PUT /identity/v3/projects/5c965248b9ca4c14a93330337c5102bc/users/0457ac0166ba4adca55b6443bfbeeca9/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:22.430162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.430449 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.430723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.459121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] MFA Rules not processed for user `0457ac0166ba4adca55b6443bfbeeca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:22.460720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:22.523403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1213/2435] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:22.527919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.591101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d8965-b43f-4360-8f23-e0d2a43f0355 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.596486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.597151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.597399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.597662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.598387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.600377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.631579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1223/2436] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:22.632813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.643930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46520c10-7f89-4df0-9bae-614265877b05 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.719764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.720539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.720903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.721233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.722017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.724062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.750672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1214/2437] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:22.751971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.762667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ee4d-2d8f-42bc-854e-35bd9063790a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.769255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.769919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.770218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.770728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.771205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.772869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.784923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1224/2438] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:22.789187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.799942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94592577-4b3f-4a88-b7c5-9182bab00eef admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.805319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.806218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.806496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.806955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] PATH_INFO: `/v3/projects/94198552716e44a09574dc58ac4c8675/users/032b4882be504115b35f6a46b99c4cfe/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.827069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94198552716e44a09574dc58ac4c8675, user_id=032b4882be504115b35f6a46b99c4cfe, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.829811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.844836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1215/2439] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:22 2022] PUT /identity/v3/projects/94198552716e44a09574dc58ac4c8675/users/032b4882be504115b35f6a46b99c4cfe/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:22.848594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.859694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c7b4d2-106d-47f6-833c-f65f7e2c71c7 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.919073 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.919871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.920215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.920553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.921448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.923243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85af27-6591-465f-a35a-f4b4f336b32b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.934226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1225/2440] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:22.938614 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:22.948911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed94751-1579-4971-8b49-f7daa3e1fc27 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:22.954112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:22.955135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.955572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.955942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] PATH_INFO: `/v3/projects/94198552716e44a09574dc58ac4c8675/users/032b4882be504115b35f6a46b99c4cfe/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:22.958060 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94198552716e44a09574dc58ac4c8675, user_id=032b4882be504115b35f6a46b99c4cfe, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:22.961004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:22.975082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1216/2441] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:22 2022] PUT /identity/v3/projects/94198552716e44a09574dc58ac4c8675/users/032b4882be504115b35f6a46b99c4cfe/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:22.986131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:22.986415 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:22.986691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:23.018130 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] MFA Rules not processed for user `032b4882be504115b35f6a46b99c4cfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:23.019479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:23.090815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1226/2442] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:23.102658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:23.104619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:23.166166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863183f2-4ec1-4fde-995a-2458c2cebbe9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:23.170163 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:23.170901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:23.171246 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:23.171649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:23.181343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:23.182914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:23.193320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1217/2443] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:48:23.691509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:23.692996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:23.704584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54136128-7c60-45d7-8ee0-377db6b932e7 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:23.708241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:23.708990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:23.709327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:23.709661 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:23.764535 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:23.766067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:23.774899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1227/2444] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:27.797473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:27.806181 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aeec20-26a8-4fba-a308-332d81c870bd service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:27.810690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:27.811325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:27.811642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:27.811909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:27.873519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:27.874886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087046b0-e7ca-485a-b511-8ae5fe4e4a2b service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:27.883824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1218/2445] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:29.961212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.024922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6d71e-6732-4baf-b3e6-80f441e86cbf service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.032066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.033076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.033370 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.033731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] PATH_INFO: `/v3/users/a5fb6c29630046fe8497b43c387ed439` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.035639 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fb6c29630046fe8497b43c387ed439)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.041310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.090082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fb6c29630046fe8497b43c387ed439'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.101802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fb6c29630046fe8497b43c387ed439'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.108430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fb6c29630046fe8497b43c387ed439'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.109100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fb6c29630046fe8497b43c387ed439'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.117562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fb6c29630046fe8497b43c387ed439'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.123671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1228/2446] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:29 2022] DELETE /identity/v3/users/a5fb6c29630046fe8497b43c387ed439 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:30.128201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.128661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.128772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.146397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:30.147640 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.205612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1219/2447] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:30.217926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.219405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.278029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148fdd9-c3c7-4508-bd50-7a4f76e61e4e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.282646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.283310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.283622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.283894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.293299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.294753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.304145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1229/2448] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:48:30.577516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.579068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:30.591516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa81069-dfaa-4946-9205-deb13d126dd9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.596269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.597149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.597411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.597689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] PATH_INFO: `/v3/projects/d020faa7f19a4087815bd3947e5ff725` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.598887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d020faa7f19a4087815bd3947e5ff725)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.600780 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.648595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd020faa7f19a4087815bd3947e5ff725', 'request_id': 'req-88451918-a52f-4223-8325-21bb4a245718'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.656945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd020faa7f19a4087815bd3947e5ff725', 'request_id': 'req-88451918-a52f-4223-8325-21bb4a245718'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.666545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd020faa7f19a4087815bd3947e5ff725', 'request_id': 'req-88451918-a52f-4223-8325-21bb4a245718'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.680948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] The token cache is being invalidate because project d020faa7f19a4087815bd3947e5ff725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:30.681232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.681853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.683416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1220/2449] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:30 2022] DELETE /identity/v3/projects/d020faa7f19a4087815bd3947e5ff725 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:30.687777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:30.697577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f3029-70a8-4996-b5a9-22c97f342f14 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:30.756788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:30.757586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:30.757868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:30.758140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] PATH_INFO: `/v3/users/0457ac0166ba4adca55b6443bfbeeca9` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:30.759421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0457ac0166ba4adca55b6443bfbeeca9)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:30.761403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:30.817112 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0457ac0166ba4adca55b6443bfbeeca9'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.832075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0457ac0166ba4adca55b6443bfbeeca9'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.838980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0457ac0166ba4adca55b6443bfbeeca9'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.839696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0457ac0166ba4adca55b6443bfbeeca9'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.848958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0457ac0166ba4adca55b6443bfbeeca9'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:30.857046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1230/2450] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:30 2022] DELETE /identity/v3/users/0457ac0166ba4adca55b6443bfbeeca9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:31.135121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:31.136745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.150706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451918-a52f-4223-8325-21bb4a245718 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:31.206300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:31.207305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:31.207623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:31.207909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] PATH_INFO: `/v3/projects/5c965248b9ca4c14a93330337c5102bc` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:31.209200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c965248b9ca4c14a93330337c5102bc)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:31.211127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:31.258277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c965248b9ca4c14a93330337c5102bc', 'request_id': 'req-f4758cb0-8550-4b6c-958e-850562dc1e8c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.263878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c965248b9ca4c14a93330337c5102bc', 'request_id': 'req-f4758cb0-8550-4b6c-958e-850562dc1e8c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.270199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c965248b9ca4c14a93330337c5102bc', 'request_id': 'req-f4758cb0-8550-4b6c-958e-850562dc1e8c'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.283706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] The token cache is being invalidate because project 5c965248b9ca4c14a93330337c5102bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:31.283986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.284631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.286191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1221/2451] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:31 2022] DELETE /identity/v3/projects/5c965248b9ca4c14a93330337c5102bc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:31.290286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:31.291870 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.304752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117758bd-4b90-45cf-8375-4b13e9c476f5 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:31.368593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:31.369476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:31.369751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:31.370022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] PATH_INFO: `/v3/users/032b4882be504115b35f6a46b99c4cfe` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:31.371349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] RBAC: Authorizing `identity:delete_user(user_id=032b4882be504115b35f6a46b99c4cfe)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:31.373291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:31.426736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032b4882be504115b35f6a46b99c4cfe'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.444107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032b4882be504115b35f6a46b99c4cfe'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.453837 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032b4882be504115b35f6a46b99c4cfe'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.454553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032b4882be504115b35f6a46b99c4cfe'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.462488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e5209720-1dc9-4b6e-b239-5c9ec140438e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032b4882be504115b35f6a46b99c4cfe'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.468784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1231/2452] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:31 2022] DELETE /identity/v3/users/032b4882be504115b35f6a46b99c4cfe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:31.743730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:31.745242 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.759547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4758cb0-8550-4b6c-958e-850562dc1e8c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:31.818542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:31.819319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:31.819633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:31.819905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] PATH_INFO: `/v3/projects/94198552716e44a09574dc58ac4c8675` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:31.821108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94198552716e44a09574dc58ac4c8675)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:31.822995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:31.875714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94198552716e44a09574dc58ac4c8675', 'request_id': 'req-442722f8-1cbc-41bf-a01a-e8d74c56a266'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.881204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94198552716e44a09574dc58ac4c8675', 'request_id': 'req-442722f8-1cbc-41bf-a01a-e8d74c56a266'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.887434 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94198552716e44a09574dc58ac4c8675', 'request_id': 'req-442722f8-1cbc-41bf-a01a-e8d74c56a266'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.901622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] The token cache is being invalidate because project 94198552716e44a09574dc58ac4c8675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:31.901908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.902604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-442722f8-1cbc-41bf-a01a-e8d74c56a266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:31.904187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1222/2453] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:31 2022] DELETE /identity/v3/projects/94198552716e44a09574dc58ac4c8675 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:31.910369 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:31.910659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:31.910937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:31.928922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:31.930103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:31.988489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1232/2454] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:32.000062 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.000352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.000617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.019142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:32.020360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:32.029373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1223/2455] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:32.034441 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.045418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f09b7b-ae8a-4a2a-999a-604df493d15d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.051168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.051855 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.052132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.052426 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.053260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:32.053569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.055165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.067691 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1233/2456] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:32.072436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.084755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6f61e-5727-4ee2-b7d8-5663b4dc06cb None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.093643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.094594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.094974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.095357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.096472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.099291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.135874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1224/2457] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:32.137499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.148019 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362b448-8535-42cb-916c-fd40f87941b5 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.204553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.205210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.205483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.205751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.206425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.208367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.231663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1234/2458] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:48:32.235861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.246463 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a1acd-38a6-4da5-8144-a36c97e861c2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.257209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.257961 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.258675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.258675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.259207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.260905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.271843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1225/2459] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:32.276018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.286055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca83b1-6c69-4533-ab95-50d46b4ede34 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.290853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.292187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.292479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.292749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.293557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.295144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d6925-d292-4576-b61a-22807c976b71 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.304961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1235/2460] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:32.308993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.319941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c182b4b-cecb-4740-a592-1c0eeddaccd4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.325951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.326772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.327055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.327332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] PATH_INFO: `/v3/projects/20de1b006e694ebc816f60399c9ea2f0/users/8dc2dff52dec4ae6b700f88886ba3373/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.342077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20de1b006e694ebc816f60399c9ea2f0, user_id=8dc2dff52dec4ae6b700f88886ba3373, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.344794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.360337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1226/2461] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:32 2022] PUT /identity/v3/projects/20de1b006e694ebc816f60399c9ea2f0/users/8dc2dff52dec4ae6b700f88886ba3373/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:32.372689 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.372999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.373276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.401345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] MFA Rules not processed for user `8dc2dff52dec4ae6b700f88886ba3373`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:32.402550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:32.471166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1236/2462] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:32.476055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.538474 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777982d-9bd2-41b3-b7a8-be21f646a921 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.543827 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.544485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.544761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.545029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.545710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.547619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.577832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1227/2463] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:32.579207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.590411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697210e-cd1d-4d83-abfd-8d3008b4f43c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.648397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.649078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.649359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.649632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.650358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.652350 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.675764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1237/2464] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:32.676988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.687667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617147c-f298-4873-a1f9-7715b5e38508 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.692551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.693203 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.693479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.693749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.694463 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.696084 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.706676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1228/2465] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:32.710749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.720960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2659d57-e443-4b91-a8af-a2f720f28288 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.726727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.727674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.727953 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.728225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] PATH_INFO: `/v3/projects/1f05a35e5d964671ae61056226f421e3/users/af613547c73f4f48aa7f70c0d2186511/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.743977 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05a35e5d964671ae61056226f421e3, user_id=af613547c73f4f48aa7f70c0d2186511, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.746752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.761527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1238/2466] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:32 2022] PUT /identity/v3/projects/1f05a35e5d964671ae61056226f421e3/users/af613547c73f4f48aa7f70c0d2186511/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:32.765758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.776529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab594ecf-494e-421f-a610-b0e7436fec10 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.837318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.837909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.838190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.838466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.839196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.840878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab094072-aa66-47fa-9ecc-10859267f783 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.853980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1229/2467] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:32.855250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:32.865589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c86dc2-92a0-44ef-9cec-1920076624e9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:32.870394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:32.871458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.871803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.872144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] PATH_INFO: `/v3/projects/1f05a35e5d964671ae61056226f421e3/users/af613547c73f4f48aa7f70c0d2186511/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.874151 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05a35e5d964671ae61056226f421e3, user_id=af613547c73f4f48aa7f70c0d2186511, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:32.876964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:32.887357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1239/2468] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:32 2022] PUT /identity/v3/projects/1f05a35e5d964671ae61056226f421e3/users/af613547c73f4f48aa7f70c0d2186511/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:32.897610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:32.897900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:32.898172 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:32.925427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] MFA Rules not processed for user `af613547c73f4f48aa7f70c0d2186511`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:32.926636 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:32.992455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1230/2469] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:33.003644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.005348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.062632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e9aad3-2873-4fac-86cd-a0e8065e64fe admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.066685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.067327 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.067640 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.067919 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.077264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.078693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1050-5f34-402a-a680-596c230c973d service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.088077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1240/2470] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:33.214274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.281762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9cf414-cfb6-46b3-8898-411f7d282d84 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.287339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.288264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.288542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.288811 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] PATH_INFO: `/v3/users/8dc2dff52dec4ae6b700f88886ba3373` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.290094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc2dff52dec4ae6b700f88886ba3373)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.292061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.349337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc2dff52dec4ae6b700f88886ba3373'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.356520 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc2dff52dec4ae6b700f88886ba3373'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.368385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc2dff52dec4ae6b700f88886ba3373'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.369093 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc2dff52dec4ae6b700f88886ba3373'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.378469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc2dff52dec4ae6b700f88886ba3373'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.384826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1231/2471] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:33 2022] DELETE /identity/v3/users/8dc2dff52dec4ae6b700f88886ba3373 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:33.389399 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.389887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.390003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.408095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:33.409265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.478512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1241/2472] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:33.488839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.491166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.557089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eebc03c-b13b-4772-9371-802451a5afa7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.561610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.562260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.562846 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.563117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.572055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.573477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.582658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1232/2473] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:33.859952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.861411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:33.873830 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6b744-2e15-4456-91f7-5b8191855630 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:33.878544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:33.879404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:33.880302 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:33.880582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] PATH_INFO: `/v3/projects/20de1b006e694ebc816f60399c9ea2f0` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:33.881868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20de1b006e694ebc816f60399c9ea2f0)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:33.883770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:33.930746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20de1b006e694ebc816f60399c9ea2f0', 'request_id': 'req-d2f304a5-0503-4269-93b8-540ad6ef3012'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.936108 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20de1b006e694ebc816f60399c9ea2f0', 'request_id': 'req-d2f304a5-0503-4269-93b8-540ad6ef3012'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.942385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20de1b006e694ebc816f60399c9ea2f0', 'request_id': 'req-d2f304a5-0503-4269-93b8-540ad6ef3012'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.954981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] The token cache is being invalidate because project 20de1b006e694ebc816f60399c9ea2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:33.955262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.955889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:33.957487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1242/2474] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:33 2022] DELETE /identity/v3/projects/20de1b006e694ebc816f60399c9ea2f0 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:33.961894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:33.971736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9867-2cfd-4d64-9777-242ea7b91fd5 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.031731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.032732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.033087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.033368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] PATH_INFO: `/v3/users/af613547c73f4f48aa7f70c0d2186511` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.034700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=af613547c73f4f48aa7f70c0d2186511)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.036891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.086473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af613547c73f4f48aa7f70c0d2186511'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.093480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af613547c73f4f48aa7f70c0d2186511'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.106231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af613547c73f4f48aa7f70c0d2186511'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.106997 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af613547c73f4f48aa7f70c0d2186511'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.115810 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ccbb764a-a511-4e51-b549-69b0001ae3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af613547c73f4f48aa7f70c0d2186511'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.122215 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1233/2475] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:33 2022] DELETE /identity/v3/users/af613547c73f4f48aa7f70c0d2186511 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:34.394483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.395994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:34.409607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f304a5-0503-4269-93b8-540ad6ef3012 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.476568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.477517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.477788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.478066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] PATH_INFO: `/v3/projects/1f05a35e5d964671ae61056226f421e3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.479263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f05a35e5d964671ae61056226f421e3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.481325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.526821 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f05a35e5d964671ae61056226f421e3', 'request_id': 'req-811a6abf-7e25-440c-a2ee-c167c610a1ba'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.532677 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f05a35e5d964671ae61056226f421e3', 'request_id': 'req-811a6abf-7e25-440c-a2ee-c167c610a1ba'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.539158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f05a35e5d964671ae61056226f421e3', 'request_id': 'req-811a6abf-7e25-440c-a2ee-c167c610a1ba'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.553167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] The token cache is being invalidate because project 1f05a35e5d964671ae61056226f421e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:34.553458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.554115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-811a6abf-7e25-440c-a2ee-c167c610a1ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:34.556249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1243/2476] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:34 2022] DELETE /identity/v3/projects/1f05a35e5d964671ae61056226f421e3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:34.561607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.562122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.562703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.580925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:34.582170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:34.640269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1234/2477] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:34.648169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.648455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.648738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.667701 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:34.669010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:34.677719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1244/2478] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:34.682166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.692918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9646-2324-4a63-8a86-fce5703a03cf None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.698420 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.699140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.699492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.699765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.700491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:34.700790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.702397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.713892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1235/2479] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:34.718301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.727628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3680243-b7f7-4e2c-8e15-7e172d801804 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.732299 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.732955 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.733240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.733518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.734201 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.736146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.765282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1245/2480] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:34.766619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.776394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f3c2-dc59-49da-a58a-249f70901362 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.831315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.832012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.832464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.832639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.833342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.835274 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.854574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1236/2481] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/users => generated 284 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:34.858625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.869427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de205aa5-6c05-4819-9bd8-db5879173291 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.874338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.875007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.875272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.875580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.876317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.878059 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.894455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1246/2482] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:34.895399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.905391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b05dd-b4d6-4528-ae45-cad19f9d507a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.910114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.910767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.911040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.911311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.912054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.913628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c2dbc-853b-4c21-8225-6ef1d6ee6eef admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.926728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1237/2483] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:34.928367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:34.939502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20af338-51c4-4cb5-b5f8-0e03b6239084 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:34.946064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:34.947045 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.947322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.947629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] PATH_INFO: `/v3/projects/bef3e31508f24d7d9758dfec8e614afb/users/96adf1c9ef5f45869a54e0568b1a2983/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:34.962726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef3e31508f24d7d9758dfec8e614afb, user_id=96adf1c9ef5f45869a54e0568b1a2983, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:34.965498 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:34.979259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1247/2484] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:34 2022] PUT /identity/v3/projects/bef3e31508f24d7d9758dfec8e614afb/users/96adf1c9ef5f45869a54e0568b1a2983/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:34.990382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:34.990681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:34.990932 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.016592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] MFA Rules not processed for user `96adf1c9ef5f45869a54e0568b1a2983`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:35.017769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:35.081553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1238/2485] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:35.085895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.147797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51948f7f-7f0f-468f-993b-8f6e329b749b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.152557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.154243 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.154840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.155193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.156017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.158475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.203484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1248/2486] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:35 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:35.207515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.231440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186b9a2-8967-44fc-a35b-70fc6f87ac72 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.335249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.336502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.337033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.337409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.338620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.341019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.367586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1239/2487] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:35 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:35.371417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.385918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e70480-dde3-4a16-8997-8371658c821c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.393792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.394585 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.395145 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.395240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.396072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.398049 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.414034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1249/2488] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:35.418225 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.432762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08d8c3-1eef-4674-8128-9f859c376a66 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.440302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.441513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.441894 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.442253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] PATH_INFO: `/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af/users/f84f2b545f1d4bf080420a3df6ad9612/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.464259 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10488ccb51f49f5bcdb5561ecf5d2af, user_id=f84f2b545f1d4bf080420a3df6ad9612, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.468680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.491129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1240/2489] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:35 2022] PUT /identity/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af/users/f84f2b545f1d4bf080420a3df6ad9612/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:35.492237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.507764 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb555e1b-16f4-40c4-8a5d-ac25d1457d85 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.562037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.562927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.563202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.563510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.564226 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.565813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41329bc3-aa8a-4fbb-b525-d15e6c1ef49f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.575409 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1250/2490] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:35.579629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.589541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a0bc9-3098-46a7-9fa0-25fd42809b1b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.594447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.595360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.595665 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.595938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] PATH_INFO: `/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af/users/f84f2b545f1d4bf080420a3df6ad9612/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.598047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10488ccb51f49f5bcdb5561ecf5d2af, user_id=f84f2b545f1d4bf080420a3df6ad9612, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.600716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.611373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1241/2491] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:35 2022] PUT /identity/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af/users/f84f2b545f1d4bf080420a3df6ad9612/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:35.621566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.621853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.622133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.647975 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] MFA Rules not processed for user `f84f2b545f1d4bf080420a3df6ad9612`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:35.649254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:35.717060 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1251/2492] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:35.728410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.731320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:35.796766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8caca56-6f28-4304-9a62-8b1f9b3bf705 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.800445 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.801131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.801406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.801671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.810946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.812706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb12584-8f7e-4588-bb08-ebe1aa02fcc8 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:35.822391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1242/2493] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:35.919573 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:35.931058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2826b07-e4dc-4700-89bd-56056fbdbe93 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:35.935156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:35.935923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:35.936265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:35.936612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:35.993111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:35.994582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:36.004090 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1252/2494] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:39.049623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f24-1197-4205-8a07-caa54b0c0bbd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:39.050211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f24-1197-4205-8a07-caa54b0c0bbd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:39.050211 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e0f24-1197-4205-8a07-caa54b0c0bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:39.068118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4c0e0f24-1197-4205-8a07-caa54b0c0bbd None None] MFA Rules not processed for user `7561c16d63774763b61bffd087aa6307`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:39.069308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4c0e0f24-1197-4205-8a07-caa54b0c0bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:39.125863 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1243/2495] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:40.697858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:40.762783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cb574-053f-4be3-be58-453af243dc9b service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:40.768315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:40.769340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:40.769620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:40.769890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] PATH_INFO: `/v3/users/96adf1c9ef5f45869a54e0568b1a2983` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:40.771136 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96adf1c9ef5f45869a54e0568b1a2983)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:40.773103 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:40.821884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96adf1c9ef5f45869a54e0568b1a2983'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:40.838092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96adf1c9ef5f45869a54e0568b1a2983'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:40.846410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96adf1c9ef5f45869a54e0568b1a2983'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:40.847644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96adf1c9ef5f45869a54e0568b1a2983'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:40.857469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96adf1c9ef5f45869a54e0568b1a2983'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:40.866358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1253/2496] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:40 2022] DELETE /identity/v3/users/96adf1c9ef5f45869a54e0568b1a2983 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:40.871264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:40.871773 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:40.871906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:40.891859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:40.893043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:40.959672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1244/2497] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:40.969367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:40.970991 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:41.028864 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896465c4-d7a5-470a-97f4-f1ad3750791e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:41.032889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:41.033598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:41.033872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:41.034143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:41.043152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:41.044605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:41.053869 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1254/2498] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:48:41.469736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:41.471169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:41.489313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e58efa-e5fa-4939-b459-49854b20834c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:41.495880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:41.496749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:41.497059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:41.497328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] PATH_INFO: `/v3/projects/bef3e31508f24d7d9758dfec8e614afb` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:41.498510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef3e31508f24d7d9758dfec8e614afb)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:41.500456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:41.546522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef3e31508f24d7d9758dfec8e614afb', 'request_id': 'req-47518605-ce2b-4fd0-8a29-6cab381026d2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.552235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef3e31508f24d7d9758dfec8e614afb', 'request_id': 'req-47518605-ce2b-4fd0-8a29-6cab381026d2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.558406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef3e31508f24d7d9758dfec8e614afb', 'request_id': 'req-47518605-ce2b-4fd0-8a29-6cab381026d2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.574254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] The token cache is being invalidate because project bef3e31508f24d7d9758dfec8e614afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:41.575323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.576089 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.577797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1245/2499] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:41 2022] DELETE /identity/v3/projects/bef3e31508f24d7d9758dfec8e614afb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:41.581747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:41.591254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32497712-ab1a-47d4-a112-273da22ea90c service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:41.645493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:41.646367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:41.646654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:41.646891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] PATH_INFO: `/v3/users/f84f2b545f1d4bf080420a3df6ad9612` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:41.648096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84f2b545f1d4bf080420a3df6ad9612)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:41.650039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:41.708860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84f2b545f1d4bf080420a3df6ad9612'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.721169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84f2b545f1d4bf080420a3df6ad9612'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.728538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84f2b545f1d4bf080420a3df6ad9612'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.729278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84f2b545f1d4bf080420a3df6ad9612'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.737342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-6398efce-6fed-415d-bb05-7bdc9c207afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84f2b545f1d4bf080420a3df6ad9612'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:41.744402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1255/2500] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:41 2022] DELETE /identity/v3/users/f84f2b545f1d4bf080420a3df6ad9612 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:42.068014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.069561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:42.092972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518605-ce2b-4fd0-8a29-6cab381026d2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.160205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.161086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.161361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.161631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] PATH_INFO: `/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.162830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10488ccb51f49f5bcdb5561ecf5d2af)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.165361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.219052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10488ccb51f49f5bcdb5561ecf5d2af', 'request_id': 'req-b851be9d-5eb1-48aa-9c36-eeae14f26166'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:42.225051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10488ccb51f49f5bcdb5561ecf5d2af', 'request_id': 'req-b851be9d-5eb1-48aa-9c36-eeae14f26166'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:42.232655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10488ccb51f49f5bcdb5561ecf5d2af', 'request_id': 'req-b851be9d-5eb1-48aa-9c36-eeae14f26166'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:42.254549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] The token cache is being invalidate because project b10488ccb51f49f5bcdb5561ecf5d2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:42.255700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:42.256794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b851be9d-5eb1-48aa-9c36-eeae14f26166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:42.259694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1246/2501] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:42 2022] DELETE /identity/v3/projects/b10488ccb51f49f5bcdb5561ecf5d2af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:42.264986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.265746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.266376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.285303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:42.286778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:42.351333 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1256/2502] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:42.360016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.360299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.360571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.397278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:42.398513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:42.417629 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1247/2503] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:42.421924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.437994 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e1d68-88d2-4cc2-abb3-ced1da4a17d8 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.442643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.443311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.443624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.443897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.444624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:42.444925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.446516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.463566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1257/2504] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:42.465350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.476518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc123ad-0c62-4bef-b869-e8fb50ff1577 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.481724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.482643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.483115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.483567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.484422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.486500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.517483 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1248/2505] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:42.520806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.531314 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3bf82-431e-415e-a235-52d40591fb8e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.589620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.590288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.590563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.590833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.591550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.593457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.613849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1258/2506] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:42.616697 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.626724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b19884-8ceb-4911-9cfe-bfd0d9a1d315 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.631154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.631837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.632144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.632413 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.633121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.634694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.645087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1249/2507] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:42.649085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.659192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a50fa-af0e-4ac4-98ec-71bddeb5be68 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.664140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.664783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.665058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.665325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.666024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.667808 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cfd8a-a285-44d4-a923-97d3be44f5c1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.677993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1259/2508] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:42.682337 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.693101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b97332-36c7-43d4-8541-47fa2581660f admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.699027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.699928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.700180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.700465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] PATH_INFO: `/v3/projects/04be8f0ae80c41e9b7a0988ca4487440/users/939b24eb2a1d4c238d2e70d803b1c708/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.715630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04be8f0ae80c41e9b7a0988ca4487440, user_id=939b24eb2a1d4c238d2e70d803b1c708, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.719663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.736989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1250/2509] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:42 2022] PUT /identity/v3/projects/04be8f0ae80c41e9b7a0988ca4487440/users/939b24eb2a1d4c238d2e70d803b1c708/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:42.747471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.748014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.748014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.774513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] MFA Rules not processed for user `939b24eb2a1d4c238d2e70d803b1c708`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:42.775773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:42.840225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1260/2510] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:42.844879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.906451 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fec4-0eac-4a67-ba06-5124ffa3cb2c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:42.911145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:42.911840 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:42.912119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:42.912396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:42.913078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:42.914981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:42.945852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1251/2511] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:42.947111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:42.958630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad07d4-a0e8-4bc6-abe2-8cd5cf3aaf0e None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.015679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.016354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.016632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.016904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.017658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.019596 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.040251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1261/2512] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:42 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:43.044142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:43.054670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11bd81-0688-4eb2-a86a-1166d9691087 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.059866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.060539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.060793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.061091 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.061837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.063877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.074821 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1252/2513] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:43.078946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:43.088985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d742f95-3e3f-4510-bdf0-28d14ba2122d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.093876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.094758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.095032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.095303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] PATH_INFO: `/v3/projects/90f94f1216ec47f9bd9ff7999091848b/users/6881b5ead8fe4f7eb5abd3f26b8eaab8/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.109897 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f94f1216ec47f9bd9ff7999091848b, user_id=6881b5ead8fe4f7eb5abd3f26b8eaab8, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.112649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.126606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1262/2514] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:43 2022] PUT /identity/v3/projects/90f94f1216ec47f9bd9ff7999091848b/users/6881b5ead8fe4f7eb5abd3f26b8eaab8/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:43.130887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:43.142098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ffffe9-e0e8-4e4e-aa5e-e5d3c5f6c251 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.205107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.205837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.206101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.206370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.207114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.208743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faadde-413e-40ce-9dd1-574467ff2041 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.222982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1253/2515] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:43.226664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:43.238727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71926-199d-4a8e-b1fa-ea89e41b1b53 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.249622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.250530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.250804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.251073 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] PATH_INFO: `/v3/projects/90f94f1216ec47f9bd9ff7999091848b/users/6881b5ead8fe4f7eb5abd3f26b8eaab8/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.253548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f94f1216ec47f9bd9ff7999091848b, user_id=6881b5ead8fe4f7eb5abd3f26b8eaab8, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.257131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.269266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1263/2516] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:43 2022] PUT /identity/v3/projects/90f94f1216ec47f9bd9ff7999091848b/users/6881b5ead8fe4f7eb5abd3f26b8eaab8/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:43.280190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61f144-542c-4079-a344-d8514df5e75d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.280567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61f144-542c-4079-a344-d8514df5e75d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.280843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61f144-542c-4079-a344-d8514df5e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.307232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-da61f144-542c-4079-a344-d8514df5e75d None None] MFA Rules not processed for user `6881b5ead8fe4f7eb5abd3f26b8eaab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:43.308511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da61f144-542c-4079-a344-d8514df5e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:43.378289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1254/2517] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:43.389948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:43.392410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:43.453693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb2de8-3fe0-423c-9de3-829d9d414497 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:43.458070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:43.458746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:43.459023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:43.459298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:43.521072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:43.522520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:43.531777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1264/2518] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:47.720378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61f144-542c-4079-a344-d8514df5e75d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:47.721857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-da61f144-542c-4079-a344-d8514df5e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:47.734768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61f144-542c-4079-a344-d8514df5e75d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:47.738574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:47.739227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:47.739551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:47.739857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:47.748974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:47.750364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cecaf-0f58-4e7c-8a78-e364e860256c service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:47.759975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1255/2519] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:52.634406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:52.698945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d82835-26e6-4b2d-bfbc-58a7804cc86d service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:52.704658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:52.705529 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:52.705809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:52.706083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] PATH_INFO: `/v3/users/939b24eb2a1d4c238d2e70d803b1c708` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:52.707367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=939b24eb2a1d4c238d2e70d803b1c708)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:52.709356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:52.759970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939b24eb2a1d4c238d2e70d803b1c708'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:52.771337 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939b24eb2a1d4c238d2e70d803b1c708'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:52.778317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939b24eb2a1d4c238d2e70d803b1c708'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:52.778989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939b24eb2a1d4c238d2e70d803b1c708'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:52.788213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939b24eb2a1d4c238d2e70d803b1c708'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:52.794584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1265/2520] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:52 2022] DELETE /identity/v3/users/939b24eb2a1d4c238d2e70d803b1c708 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:52.799533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:52.800035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:52.800145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:52.818750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:52.819968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:52.882094 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1256/2521] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:48:52.892048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:52.893532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:52.952725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555c906-2bdd-4495-9962-c94c88be54f3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:52.956721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:52.957358 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:52.957636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:52.957896 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:52.966999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:52.968486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:52.978132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1266/2522] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:53.259067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:53.260670 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:53.272599 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e09c5-29c0-43c6-a862-2db24158dbf9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:53.278286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:53.279162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:53.279564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:53.279724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] PATH_INFO: `/v3/projects/04be8f0ae80c41e9b7a0988ca4487440` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:53.281069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04be8f0ae80c41e9b7a0988ca4487440)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:53.283108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:53.333982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04be8f0ae80c41e9b7a0988ca4487440', 'request_id': 'req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.339471 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04be8f0ae80c41e9b7a0988ca4487440', 'request_id': 'req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.345646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04be8f0ae80c41e9b7a0988ca4487440', 'request_id': 'req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.359959 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] The token cache is being invalidate because project 04be8f0ae80c41e9b7a0988ca4487440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:53.360244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.360870 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.362404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1257/2523] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:53 2022] DELETE /identity/v3/projects/04be8f0ae80c41e9b7a0988ca4487440 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:53.366432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:53.376567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ac357-4bc0-4a6f-80aa-b8b519e9c9dc service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:53.435668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:53.436888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:53.437194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:53.437466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] PATH_INFO: `/v3/users/6881b5ead8fe4f7eb5abd3f26b8eaab8` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:53.438780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6881b5ead8fe4f7eb5abd3f26b8eaab8)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:53.440780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:53.489775 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6881b5ead8fe4f7eb5abd3f26b8eaab8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.501077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6881b5ead8fe4f7eb5abd3f26b8eaab8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.508206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6881b5ead8fe4f7eb5abd3f26b8eaab8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.509005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6881b5ead8fe4f7eb5abd3f26b8eaab8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.518165 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-70ae7a40-0414-429e-b82b-5607aa246388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6881b5ead8fe4f7eb5abd3f26b8eaab8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.524176 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1267/2524] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:48:53 2022] DELETE /identity/v3/users/6881b5ead8fe4f7eb5abd3f26b8eaab8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:48:53.798547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:53.800029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:53.815216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd223e-62a1-4d45-8bd5-69ca6ed43213 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:53.882123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:53.882899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:53.883339 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:53.883795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] PATH_INFO: `/v3/projects/90f94f1216ec47f9bd9ff7999091848b` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:53.885594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f94f1216ec47f9bd9ff7999091848b)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:53.888282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:53.945862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f94f1216ec47f9bd9ff7999091848b', 'request_id': 'req-6fe2c5da-6d3c-499a-89e3-751d42b18270'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.952439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f94f1216ec47f9bd9ff7999091848b', 'request_id': 'req-6fe2c5da-6d3c-499a-89e3-751d42b18270'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.959851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f94f1216ec47f9bd9ff7999091848b', 'request_id': 'req-6fe2c5da-6d3c-499a-89e3-751d42b18270'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.974615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] The token cache is being invalidate because project 90f94f1216ec47f9bd9ff7999091848b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:48:53.974898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.975649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6fe2c5da-6d3c-499a-89e3-751d42b18270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:48:53.977329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1258/2525] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:48:53 2022] DELETE /identity/v3/projects/90f94f1216ec47f9bd9ff7999091848b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:53.983776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:53.984308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:53.984308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.002804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:54.004037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:54.068075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1268/2526] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:54.076721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.077006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.077275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.096567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:54.097749 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:54.106090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1259/2527] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:54.110366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.120780 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b4826-d10d-40c5-b935-3a714aaa2d04 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.126819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.127525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.127799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.128067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.128803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:48:54.129104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.130745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.143221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1269/2528] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:48:54.147594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.157313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71fd784-7158-4798-bc99-3698f83d4887 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.162206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.162883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.163158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.163456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.164176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.166116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.194536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1260/2529] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:54.198985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.209037 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9dce-444c-4076-8afe-20b8b6991e3e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.266905 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.267620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.267903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.268174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.268878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.270804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.294362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1270/2530] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:54.297005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.307543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8eeffd-ab2c-40a2-bee3-2dd437d80e80 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.313412 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.314066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.314342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.314611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.315330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.316955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.327716 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1261/2531] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:54.331606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.343455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeccc5b-b873-4a5c-948d-11b9793cdbad admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.352200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.353147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.353450 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.353770 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.354715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.356391 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9900385c-d070-4fa8-8705-a24c0ca9d342 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.367374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1271/2532] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:54.371722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.382251 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955af58-4a2b-4781-93bf-4a3cd4bb613b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.388236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339919-2740-4700-a517-d439841ff6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.389113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339919-2740-4700-a517-d439841ff6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.389401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339919-2740-4700-a517-d439841ff6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.389683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339919-2740-4700-a517-d439841ff6be admin admin] PATH_INFO: `/v3/projects/33f39fe712c042a0a75e33444a7c582c/users/a384943f69be4aedb9b6725085a13136/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.405689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339919-2740-4700-a517-d439841ff6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f39fe712c042a0a75e33444a7c582c, user_id=a384943f69be4aedb9b6725085a13136, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.408322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339919-2740-4700-a517-d439841ff6be admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.424543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1262/2533] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:54 2022] PUT /identity/v3/projects/33f39fe712c042a0a75e33444a7c582c/users/a384943f69be4aedb9b6725085a13136/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:54.435960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.436256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.436841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.463587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] MFA Rules not processed for user `a384943f69be4aedb9b6725085a13136`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:54.464790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:54.531654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1272/2534] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:54.536257 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339919-2740-4700-a517-d439841ff6be admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.597360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339919-2740-4700-a517-d439841ff6be admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.602837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.603508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.603782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.604081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.604787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.606668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.634184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1263/2535] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:54.640382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.655607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac24375-6691-4c54-a082-c81392bb62d2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.716761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.717343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.717606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.717872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.718547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.720553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.743166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1273/2536] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:54.747237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.757898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360a1a9-bbf6-4e33-af13-433f68c33be1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.764088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.765064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.765351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.765623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.766343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.767955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.778861 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1264/2537] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:54.783119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.799107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da0600-318f-4d54-9859-924d3e84d478 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.807951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.808607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.808886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.809155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.809880 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.811779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce5627-9a01-4cc1-aa11-3790eb0db72e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.821956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1274/2538] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:54.826229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:54.836276 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3889ab7-372e-4ef1-9e6a-86c29183e8e2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:54.841136 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:54.842015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.842292 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.842553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] PATH_INFO: `/v3/projects/dd2cab0b75ef4460b8feb7114aa9dc97/users/5dd9e3d72ff747a195fe0d030162209d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.857140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2cab0b75ef4460b8feb7114aa9dc97, user_id=5dd9e3d72ff747a195fe0d030162209d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:54.859802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:54.875285 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1265/2539] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:54 2022] PUT /identity/v3/projects/dd2cab0b75ef4460b8feb7114aa9dc97/users/5dd9e3d72ff747a195fe0d030162209d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:54.939307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:54.939622 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:54.939851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:54.969357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] MFA Rules not processed for user `5dd9e3d72ff747a195fe0d030162209d`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:54.970495 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:55.046693 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1275/2540] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:55.051355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.115839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c3565-c7c8-4452-aa6c-1387ff56cd57 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.122917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.123988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.124409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.124778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.125789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.128790 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.159235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1266/2541] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:48:55 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:55.163538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.174359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820236-c05c-477f-9b61-e3d26d200d28 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.234979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.235593 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.235881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.236153 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.236840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.238840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.259804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1276/2542] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:48:55 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:48:55.263897 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.274165 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b2dad-e7ee-482a-8313-5347ec145090 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.279528 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.280185 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.280499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.281033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.281772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.283491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.295765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1267/2543] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:48:55.300078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.310420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5bac16-6dc2-4ae0-8093-3976c21e2568 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.315928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.316804 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.317087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.317356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] PATH_INFO: `/v3/projects/e8be9d26e0d64d21bc630574d197bd3b/users/27cbba3531c74ac184c9f7ba79709fc0/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.332263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8be9d26e0d64d21bc630574d197bd3b, user_id=27cbba3531c74ac184c9f7ba79709fc0, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.334892 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.350407 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1277/2544] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:55 2022] PUT /identity/v3/projects/e8be9d26e0d64d21bc630574d197bd3b/users/27cbba3531c74ac184c9f7ba79709fc0/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:55.354507 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.365909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced0082-716b-4241-b9d4-f18703ee6fde admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.421849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.422510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.422789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.423063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.423817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.425415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e833af-9b3f-4bb6-b496-b978cee61d9d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.435816 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1268/2545] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:48:55.442613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.458006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ff32e-c9d5-4840-bf64-51a3dd315c79 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.463961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.464833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.465104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.465365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] PATH_INFO: `/v3/projects/e8be9d26e0d64d21bc630574d197bd3b/users/27cbba3531c74ac184c9f7ba79709fc0/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.467620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8be9d26e0d64d21bc630574d197bd3b, user_id=27cbba3531c74ac184c9f7ba79709fc0, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.470272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.480970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1278/2546] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:48:55 2022] PUT /identity/v3/projects/e8be9d26e0d64d21bc630574d197bd3b/users/27cbba3531c74ac184c9f7ba79709fc0/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:48:55.491150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.491328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.491682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.519265 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] MFA Rules not processed for user `27cbba3531c74ac184c9f7ba79709fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:48:55.520551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:55.599458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1269/2547] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:48:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:48:55.611884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:55.614968 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:55.677091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd08857-9f25-426b-b238-ba6fba796f8d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:55.680906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:55.681577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:55.681853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:55.682200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:55.745076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:55.746456 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:55.755732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1279/2548] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:57.263164 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:57.264658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:48:57.277284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879285be-1b3f-44f0-848c-8797f42d8f17 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:57.281001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:57.281634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:57.281909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:57.282214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:57.341688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:57.343117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:57.352462 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1270/2549] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:48:57.920660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:48:57.929606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311271fc-ecda-48b2-9c2d-57dd2d9eb251 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:48:57.933868 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:48:57.934507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:48:57.934785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:48:57.935082 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:48:57.944367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:48:57.945838 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f523c9b-6234-443d-9dd6-aa695ea68509 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:48:57.955127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1280/2550] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:48:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:01.852744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:01.924299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ca20-f9de-4457-bfee-aeaa77e1fa2f service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:01.929958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:01.930793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:01.931101 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:01.931374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] PATH_INFO: `/v3/users/a384943f69be4aedb9b6725085a13136` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:01.932631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a384943f69be4aedb9b6725085a13136)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:01.934538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:01.982342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a384943f69be4aedb9b6725085a13136'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:01.989056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a384943f69be4aedb9b6725085a13136'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.001711 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a384943f69be4aedb9b6725085a13136'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.002453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a384943f69be4aedb9b6725085a13136'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.011346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a384943f69be4aedb9b6725085a13136'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.018918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1271/2551] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:01 2022] DELETE /identity/v3/users/a384943f69be4aedb9b6725085a13136 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:49:02.023572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:02.024050 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:02.024263 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:02.042259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:02.043479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:02.104571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1281/2552] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:02.115967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:02.117628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:02.181865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f2234-78bb-4d43-8c49-b3992fd3d7a0 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:02.186597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:02.187238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:02.187595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:02.187866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:02.198701 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:02.200153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:02.209469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1272/2553] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:02.475148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:02.476746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:02.488803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950079f4-1303-4f8f-8357-fdd36adb714c None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:02.493887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:02.494951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:02.495229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:02.495555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] PATH_INFO: `/v3/projects/33f39fe712c042a0a75e33444a7c582c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:02.496767 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f39fe712c042a0a75e33444a7c582c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:02.498653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:02.551088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f39fe712c042a0a75e33444a7c582c', 'request_id': 'req-e7fa6bec-ec47-44fe-8af0-e62cfb864409'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.556367 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f39fe712c042a0a75e33444a7c582c', 'request_id': 'req-e7fa6bec-ec47-44fe-8af0-e62cfb864409'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.562881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f39fe712c042a0a75e33444a7c582c', 'request_id': 'req-e7fa6bec-ec47-44fe-8af0-e62cfb864409'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.575882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] The token cache is being invalidate because project 33f39fe712c042a0a75e33444a7c582c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:02.576158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.576769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.578300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1282/2554] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:02 2022] DELETE /identity/v3/projects/33f39fe712c042a0a75e33444a7c582c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:02.582553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:02.592216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bab3f5-c7bb-471d-b506-5db6d9e73a73 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:02.646045 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:02.646904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:02.647180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:02.647480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] PATH_INFO: `/v3/users/5dd9e3d72ff747a195fe0d030162209d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:02.648689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd9e3d72ff747a195fe0d030162209d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:02.650608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:02.700209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd9e3d72ff747a195fe0d030162209d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.707168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd9e3d72ff747a195fe0d030162209d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.719812 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd9e3d72ff747a195fe0d030162209d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.720556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd9e3d72ff747a195fe0d030162209d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.730036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd9e3d72ff747a195fe0d030162209d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:02.735967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1273/2555] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:02 2022] DELETE /identity/v3/users/5dd9e3d72ff747a195fe0d030162209d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:03.008212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:03.009663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:03.025088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa6bec-ec47-44fe-8af0-e62cfb864409 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:03.082583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:03.083483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.083751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.084016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] PATH_INFO: `/v3/projects/dd2cab0b75ef4460b8feb7114aa9dc97` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.085183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2cab0b75ef4460b8feb7114aa9dc97)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:03.087076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:03.132996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2cab0b75ef4460b8feb7114aa9dc97', 'request_id': 'req-d31ea966-1ee8-4378-b54f-abc7555f9156'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.138444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2cab0b75ef4460b8feb7114aa9dc97', 'request_id': 'req-d31ea966-1ee8-4378-b54f-abc7555f9156'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.144526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2cab0b75ef4460b8feb7114aa9dc97', 'request_id': 'req-d31ea966-1ee8-4378-b54f-abc7555f9156'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.158431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] The token cache is being invalidate because project dd2cab0b75ef4460b8feb7114aa9dc97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:03.158715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.159315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.160862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1283/2556] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:03 2022] DELETE /identity/v3/projects/dd2cab0b75ef4460b8feb7114aa9dc97 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:03.164891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:03.166373 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:03.178740 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7d12b-8741-4fde-9a28-68a2be5191b5 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:03.236690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:03.237707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.237989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.238269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] PATH_INFO: `/v3/users/27cbba3531c74ac184c9f7ba79709fc0` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.239584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cbba3531c74ac184c9f7ba79709fc0)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:03.241518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:03.292721 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cbba3531c74ac184c9f7ba79709fc0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.300396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cbba3531c74ac184c9f7ba79709fc0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.313382 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cbba3531c74ac184c9f7ba79709fc0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.314103 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cbba3531c74ac184c9f7ba79709fc0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.323199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4d7e7047-e8bf-4041-b337-a0f1da8f42dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cbba3531c74ac184c9f7ba79709fc0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.329166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1274/2557] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:03 2022] DELETE /identity/v3/users/27cbba3531c74ac184c9f7ba79709fc0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:03.631863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:03.633525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:03.650909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ea966-1ee8-4378-b54f-abc7555f9156 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:03.710110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:03.710551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.710943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.711290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] PATH_INFO: `/v3/projects/e8be9d26e0d64d21bc630574d197bd3b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.712877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8be9d26e0d64d21bc630574d197bd3b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:03.715186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:03.761196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8be9d26e0d64d21bc630574d197bd3b', 'request_id': 'req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.766627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8be9d26e0d64d21bc630574d197bd3b', 'request_id': 'req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.774895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8be9d26e0d64d21bc630574d197bd3b', 'request_id': 'req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.789574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] The token cache is being invalidate because project e8be9d26e0d64d21bc630574d197bd3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:03.789876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.790492 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-df6883cc-caa3-4a5f-a1f4-2d9fcd5a56ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:03.792051 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1284/2558] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:03 2022] DELETE /identity/v3/projects/e8be9d26e0d64d21bc630574d197bd3b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:03.798033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.798362 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.798632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.816789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:03.817964 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:03.880622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1275/2559] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:03.892932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.893368 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.893791 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.916309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:03.917558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:03.927032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1285/2560] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:03.931281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:03.941316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239fd71-75ca-4b7e-9c4a-719e1f095787 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:03.947118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:03.947801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.948069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.948332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.949052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:49:03.949349 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:03.950931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:03.965361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1276/2561] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:49:03.969708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:03.981039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d3812-e4b6-4a57-a4b3-feb38d11d17a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:03.986963 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:03.987649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:03.987922 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:03.988192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:03.988898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:03.990785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.017650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1286/2562] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:49:03 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:49:04.021884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:04.032825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c21c3-f62e-4aeb-a3be-e84e81365e25 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:04.095782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:04.096436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.096708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.096980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.097654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:04.099581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.119454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1277/2563] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:49:04 2022] POST /identity/v3/users => generated 282 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:49:04.123642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:04.134005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cef441-6f3c-4f45-9b74-2da2e2b34de4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:04.139084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:04.139772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.140052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.140323 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.141042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:04.142626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.153042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1287/2564] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:49:04.156884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:04.167568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e38be2-1417-448c-a33d-b78248c2e846 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:04.173500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:04.174186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.174466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.174770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.175586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:04.177655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca42775-4fb9-4fe2-a286-24d7a359b8b0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.194218 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1278/2565] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:49:04.200039 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:04.214790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af158a-d660-4a00-a822-39d8b1efd61b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:04.220342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:04.221152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.221513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.221795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] PATH_INFO: `/v3/projects/35ebe6a8858142308ba1addd920c0fd8/users/f7ce0d8c28fd40c590cecc97f0bc4638/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.240349 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ebe6a8858142308ba1addd920c0fd8, user_id=f7ce0d8c28fd40c590cecc97f0bc4638, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:04.243007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.259005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1288/2566] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:49:04 2022] PUT /identity/v3/projects/35ebe6a8858142308ba1addd920c0fd8/users/f7ce0d8c28fd40c590cecc97f0bc4638/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:04.270579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fb2d-e402-4012-abde-296893e091cc None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.270868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fb2d-e402-4012-abde-296893e091cc None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.271142 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528fb2d-e402-4012-abde-296893e091cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.298914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b528fb2d-e402-4012-abde-296893e091cc None None] MFA Rules not processed for user `f7ce0d8c28fd40c590cecc97f0bc4638`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:04.300152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b528fb2d-e402-4012-abde-296893e091cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:04.361886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1279/2567] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:49:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:04.375826 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:04.377790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:04.435305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0032c-7584-4a27-85f7-eb5bbc45da8d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:04.439829 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:04.440462 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:04.440739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:04.441006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:04.449938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:04.451355 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:04.460026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1289/2568] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:22.947579 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528fb2d-e402-4012-abde-296893e091cc None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:22.948865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b528fb2d-e402-4012-abde-296893e091cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:23.012174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528fb2d-e402-4012-abde-296893e091cc None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:23.015799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:23.016453 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:23.016942 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:23.017384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:23.019219 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:23.081918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:23.083405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:23.093077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1280/2569] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:29.880796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:29.882298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:29.897625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09b467-fd90-499a-8717-37a37319d336 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:29.902152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:29.903026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:29.903300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:29.903630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] PATH_INFO: `/v3/users/81ea59cb5330499189962477437b151c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:29.904800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ea59cb5330499189962477437b151c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:29.906714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:29.964703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ea59cb5330499189962477437b151c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.976424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ea59cb5330499189962477437b151c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.982987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ea59cb5330499189962477437b151c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.983736 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ea59cb5330499189962477437b151c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.992832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ea59cb5330499189962477437b151c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:29.999354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1290/2570] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:29 2022] DELETE /identity/v3/users/81ea59cb5330499189962477437b151c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:30.179278 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:30.190085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24ea5b-078e-4ade-94e5-ea9e29adf1c9 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:30.245834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:30.246896 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.247346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.247714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] PATH_INFO: `/v3/projects/0d5e29b8ac49423f9b0ce4eeb03e6be5` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.249125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5e29b8ac49423f9b0ce4eeb03e6be5)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:30.251039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:30.300333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5e29b8ac49423f9b0ce4eeb03e6be5', 'request_id': 'req-4ff82d6a-219f-49a7-9899-1b4b4d97526a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.305799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5e29b8ac49423f9b0ce4eeb03e6be5', 'request_id': 'req-4ff82d6a-219f-49a7-9899-1b4b4d97526a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.312551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5e29b8ac49423f9b0ce4eeb03e6be5', 'request_id': 'req-4ff82d6a-219f-49a7-9899-1b4b4d97526a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.327137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] The token cache is being invalidate because project 0d5e29b8ac49423f9b0ce4eeb03e6be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:30.327455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.328082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.329632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1281/2571] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:30 2022] DELETE /identity/v3/projects/0d5e29b8ac49423f9b0ce4eeb03e6be5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:30.333979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:30.335670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:30.349655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6c7f4-246a-406d-9c4c-818e97a665b4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:30.413642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:30.414737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.414932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.415211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] PATH_INFO: `/v3/users/d35160242aac4e75a01b09a9f4173e0b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.416603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35160242aac4e75a01b09a9f4173e0b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:30.418569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:30.471680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35160242aac4e75a01b09a9f4173e0b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.485710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35160242aac4e75a01b09a9f4173e0b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.493461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35160242aac4e75a01b09a9f4173e0b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.494320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35160242aac4e75a01b09a9f4173e0b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.504820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-0ede8fe2-6506-4ffe-8cb8-3869283ff253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35160242aac4e75a01b09a9f4173e0b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.510865 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1291/2572] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:30 2022] DELETE /identity/v3/users/d35160242aac4e75a01b09a9f4173e0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:30.693488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:30.694972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:30.710524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff82d6a-219f-49a7-9899-1b4b4d97526a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:30.769632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:30.770423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:30.770693 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:30.770968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] PATH_INFO: `/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:30.772193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c6828cf4f44fa8abce304bf3506cd6)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:30.774245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:30.821271 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c6828cf4f44fa8abce304bf3506cd6', 'request_id': 'req-88f0a278-749b-40ef-874b-1c6ede1f0657'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.826496 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c6828cf4f44fa8abce304bf3506cd6', 'request_id': 'req-88f0a278-749b-40ef-874b-1c6ede1f0657'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.832620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c6828cf4f44fa8abce304bf3506cd6', 'request_id': 'req-88f0a278-749b-40ef-874b-1c6ede1f0657'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.846795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] The token cache is being invalidate because project b6c6828cf4f44fa8abce304bf3506cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:30.847081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.847786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:30.849367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1282/2573] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:30 2022] DELETE /identity/v3/projects/b6c6828cf4f44fa8abce304bf3506cd6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:46.946157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:46.946752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:46.946752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:46.964849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:46.966067 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:47.025032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1292/2574] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:49:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:47.070887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:47.073038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:47.146979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0a278-749b-40ef-874b-1c6ede1f0657 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:47.153170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:47.153880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:47.154155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:47.154431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:47.164169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:47.165724 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3488410-2601-4b92-9210-e5a8ff2412db service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:47.173755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1283/2575] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:49:53.286011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:53.287626 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:53.357236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec1060-f9c2-4caa-ae81-6c389015d307 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:53.363069 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:53.364000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:53.364276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:53.364549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] PATH_INFO: `/v3/users/f7ce0d8c28fd40c590cecc97f0bc4638` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:53.365844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ce0d8c28fd40c590cecc97f0bc4638)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:53.368432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:53.421026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ce0d8c28fd40c590cecc97f0bc4638'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:53.432672 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ce0d8c28fd40c590cecc97f0bc4638'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:53.439805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ce0d8c28fd40c590cecc97f0bc4638'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:53.440872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ce0d8c28fd40c590cecc97f0bc4638'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:53.449093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ce0d8c28fd40c590cecc97f0bc4638'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:53.456146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1293/2576] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:49:53 2022] DELETE /identity/v3/users/f7ce0d8c28fd40c590cecc97f0bc4638 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:53.460787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:53.461836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:53.462119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:53.480939 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:49:53.483906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:53.573040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1284/2577] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:49:53.582653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:53.584267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:53.651645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a567fb-c966-410e-ad59-e60495bd6341 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:53.656432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:53.657191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:53.657540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:53.657875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:53.675250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:53.676901 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:53.688143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1294/2578] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:49:53.997017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:53.999365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:54.017137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbe645c-53cc-423e-b137-f048e387ebc2 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:54.024454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:54.025490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:54.025782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:54.026069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] PATH_INFO: `/v3/projects/35ebe6a8858142308ba1addd920c0fd8` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:54.027515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ebe6a8858142308ba1addd920c0fd8)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:54.030884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:54.097365 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ebe6a8858142308ba1addd920c0fd8', 'request_id': 'req-f5c5aeee-97af-4155-80fa-6edfd490f8f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:54.103880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ebe6a8858142308ba1addd920c0fd8', 'request_id': 'req-f5c5aeee-97af-4155-80fa-6edfd490f8f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:54.111107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ebe6a8858142308ba1addd920c0fd8', 'request_id': 'req-f5c5aeee-97af-4155-80fa-6edfd490f8f2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:54.128767 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] The token cache is being invalidate because project 35ebe6a8858142308ba1addd920c0fd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:49:54.129055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:54.129720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:49:54.131438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1285/2579] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:49:53 2022] DELETE /identity/v3/projects/35ebe6a8858142308ba1addd920c0fd8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:49:59.498101 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:49:59.507417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f45c0-ea1b-444d-9925-527ed60d8d65 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:49:59.559605 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:49:59.560283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:49:59.560568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:49:59.560845 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:49:59.562816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:49:59.634951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:49:59.636598 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:49:59.648435 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1295/2580] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:49:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:00.835994 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:00.837838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:00.852308 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c5aeee-97af-4155-80fa-6edfd490f8f2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:00.857158 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:00.857797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:00.858073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:00.858342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:00.860426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:00.875036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:00.876584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:00.887306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1286/2581] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:03.039402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:03.040833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:03.099650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2efc1-4b7e-4fcb-848b-502a3ca946ec service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:03.103252 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:03.103924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:03.104200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:03.104473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:03.106224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:03.123088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:03.124635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:03.135253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1296/2582] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:03.204406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:03.206657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:03.224350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14b83-ea81-4e36-afac-e3c4dad66ea0 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:03.229929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:03.230570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:03.230847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:03.231118 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:03.233238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:03.243188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:03.244644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e050e794-b493-460b-898b-b154026d7fb2 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:03.253081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1287/2583] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:03.328310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:03.337743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8cd41d-2c6e-4129-8477-89278a99a149 service glance] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:03.341841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:03.342473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:03.342751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:03.343009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:03.344989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:03.358268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:03.359787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:03.370521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1297/2584] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:05.064115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:05.064706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:05.064706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:05.083795 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:05.085053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:05.149166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1288/2585] 10.222.0.23 () {58 vars in 1009 bytes} [Wed May 4 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:50:05.162080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:05.163644 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:05.234154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066df284-c851-47f2-b648-99f4ad2c8b20 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:05.242604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:05.243268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:05.243576 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:05.243852 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:05.252823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:05.254412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ac597-6e60-409d-a164-08cf1dbbbe5f service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:05.262747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1298/2586] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:50:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:50:12.506305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:12.507892 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:12.522758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb7021-c8be-4ccc-b828-6a0ed15c5414 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:12.540289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:12.540977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:12.541255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:12.541526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:12.543477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:12.640182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:12.641781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:12.651061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1289/2587] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:30.788938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c346-b3b4-4490-a874-aefdcbe370eb None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:30.789526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c346-b3b4-4490-a874-aefdcbe370eb None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:30.789630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15c346-b3b4-4490-a874-aefdcbe370eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:30.807453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ac15c346-b3b4-4490-a874-aefdcbe370eb None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:30.808916 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ac15c346-b3b4-4490-a874-aefdcbe370eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:30.816660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1299/2588] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:50:30.829871 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:30.848439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa40b0e-e27c-40a9-9ec3-78b2a774009e service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:30.854007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:30.854646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:30.854941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:30.855207 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:30.863548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:30.865193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c823da-8da2-4248-b20f-247d97ff390c service swift] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:30.873834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1290/2589] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:50:36.088604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:36.089199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:36.089199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:36.106722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] MFA Rules not processed for user `4659bfb748294775b81b1dff3e77c5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:36.107978 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:36.164242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1300/2590] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:50:48.908868 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:48.909375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:48.909490 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:48.927095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] MFA Rules not processed for user `907472893cec4b2ab7ee51b10aa1a214`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:50:48.928375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:48.936510 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1291/2591] 10.222.0.23 () {58 vars in 967 bytes} [Wed May 4 21:50:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:50:48.961454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:48.973966 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0111b0-ff06-454c-9b52-a5d31fadd3a3 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:48.979514 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb0727d888284c15a4eb6fd7126f7d3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:48.980170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:48.980448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:48.980718 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:48.989183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:48.990765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:48.998566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1301/2592] 10.222.0.23 () {60 vars in 1384 bytes} [Wed May 4 21:50:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 04 21:50:54.417357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:54.427016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae19a7-e7ac-43c9-bfb2-9295f38ec761 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:54.430726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:54.431406 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:54.431698 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:54.432117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:54.433981 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:54.501340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:54.503081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:54.513452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1292/2593] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:50:54 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:50:55.890954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:55.892721 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:55.969158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860e89c-ad1f-421b-913f-df7962015c43 service swift] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:55.979274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:55.984447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:55.984745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:55.985028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] PATH_INFO: `/v3/users/29753f533caa4371a7ff36514149438c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:55.986303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29753f533caa4371a7ff36514149438c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:55.988356 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:56.034397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29753f533caa4371a7ff36514149438c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.046802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29753f533caa4371a7ff36514149438c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.054531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29753f533caa4371a7ff36514149438c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.055308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29753f533caa4371a7ff36514149438c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.064606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29753f533caa4371a7ff36514149438c'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.071097 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1302/2594] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:50:55 2022] DELETE /identity/v3/users/29753f533caa4371a7ff36514149438c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:50:56.316282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:56.328403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678d039-350f-4158-854b-b6997bfeed85 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:56.406860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:56.407764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:56.408046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:56.408323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] PATH_INFO: `/v3/projects/9b8ef92f23d84056b1d9aaf209751e94` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:56.409540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8ef92f23d84056b1d9aaf209751e94)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:56.411466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:56.458269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8ef92f23d84056b1d9aaf209751e94', 'request_id': 'req-955ebf7f-74c0-4193-a527-65481cf16fd2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.463519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8ef92f23d84056b1d9aaf209751e94', 'request_id': 'req-955ebf7f-74c0-4193-a527-65481cf16fd2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.469720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8ef92f23d84056b1d9aaf209751e94', 'request_id': 'req-955ebf7f-74c0-4193-a527-65481cf16fd2'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.482990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] The token cache is being invalidate because project 9b8ef92f23d84056b1d9aaf209751e94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:50:56.484581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.485224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.487083 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1293/2595] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:50:56 2022] DELETE /identity/v3/projects/9b8ef92f23d84056b1d9aaf209751e94 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:50:56.491054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:56.492577 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:56.506085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097aaea-f836-4d0a-9308-97e38115611e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:56.567096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:56.567924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:56.568206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:56.568485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] PATH_INFO: `/v3/users/7339d4da538d4533bc7c3fd5e4177b4a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:56.569733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7339d4da538d4533bc7c3fd5e4177b4a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:56.571815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:56.618442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7339d4da538d4533bc7c3fd5e4177b4a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.630008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7339d4da538d4533bc7c3fd5e4177b4a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.636929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7339d4da538d4533bc7c3fd5e4177b4a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.637731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7339d4da538d4533bc7c3fd5e4177b4a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.645920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7339d4da538d4533bc7c3fd5e4177b4a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.654081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1303/2596] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:50:56 2022] DELETE /identity/v3/users/7339d4da538d4533bc7c3fd5e4177b4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:50:56.825735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:50:56.827321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:50:56.853671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ebf7f-74c0-4193-a527-65481cf16fd2 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:50:56.911104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:50:56.912367 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:50:56.912646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:50:56.912928 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] PATH_INFO: `/v3/projects/bbc62504ac9f4491a641614c5a1fddf3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:50:56.914199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc62504ac9f4491a641614c5a1fddf3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:50:56.916169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:50:56.965015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc62504ac9f4491a641614c5a1fddf3', 'request_id': 'req-d6e03be1-bc9f-4012-b790-21392c2cefd3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.972332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc62504ac9f4491a641614c5a1fddf3', 'request_id': 'req-d6e03be1-bc9f-4012-b790-21392c2cefd3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.980902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc62504ac9f4491a641614c5a1fddf3', 'request_id': 'req-d6e03be1-bc9f-4012-b790-21392c2cefd3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.994786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] The token cache is being invalidate because project bbc62504ac9f4491a641614c5a1fddf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:50:56.995200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:56.995993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:50:57.005428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1294/2597] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:50:56 2022] DELETE /identity/v3/projects/bbc62504ac9f4491a641614c5a1fddf3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:02.840035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:02.841871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:02.900569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b22c1a-5470-4181-a1fa-48fe81248f7b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:02.949330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:02.949990 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:02.950272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:02.950541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:02.952752 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:03.017931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:03.019289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:03.029071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1304/2598] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:06.309543 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:06.313040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:06.332881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03be1-bc9f-4012-b790-21392c2cefd3 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:06.338266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:06.339144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.339454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.339735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] PATH_INFO: `/v3/users/7561c16d63774763b61bffd087aa6307` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.358608 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7561c16d63774763b61bffd087aa6307)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:06.360624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:06.418484 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7561c16d63774763b61bffd087aa6307'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.425058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7561c16d63774763b61bffd087aa6307'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.437121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7561c16d63774763b61bffd087aa6307'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.437838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7561c16d63774763b61bffd087aa6307'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.445521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-650706e9-6053-4ef0-ac6b-136e3cb2d7a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7561c16d63774763b61bffd087aa6307'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.451725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1295/2599] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:51:06 2022] DELETE /identity/v3/users/7561c16d63774763b61bffd087aa6307 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:51:06.641362 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:06.653188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e93-a035-4442-9f16-a63c27755c97 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:06.711549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:06.712422 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.712702 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.712974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] PATH_INFO: `/v3/projects/4cdbf9d036b4410b81ef59b92ef8e56c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.724459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdbf9d036b4410b81ef59b92ef8e56c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:06.726387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:06.775911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdbf9d036b4410b81ef59b92ef8e56c', 'request_id': 'req-392e20b7-5977-48b7-b8ef-64921cbc9a21'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.781607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdbf9d036b4410b81ef59b92ef8e56c', 'request_id': 'req-392e20b7-5977-48b7-b8ef-64921cbc9a21'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.788414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdbf9d036b4410b81ef59b92ef8e56c', 'request_id': 'req-392e20b7-5977-48b7-b8ef-64921cbc9a21'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.802307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] The token cache is being invalidate because project 4cdbf9d036b4410b81ef59b92ef8e56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:51:06.802586 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.803359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-392e20b7-5977-48b7-b8ef-64921cbc9a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:06.805084 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1305/2600] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:51:06 2022] DELETE /identity/v3/projects/4cdbf9d036b4410b81ef59b92ef8e56c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:06.810249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.810526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.810819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.828799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:06.829991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:06.889043 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1296/2601] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:06.897875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.898167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.898439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.916670 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:06.917884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:06.927057 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1306/2602] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:06.931299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:06.941375 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f1777-ee31-4500-be08-cab070b470b5 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:06.946703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:06.947370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.947680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.947951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.948700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:51:06.948995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:06.950625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:06.962764 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1297/2603] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:51:06.966912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:06.976473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89eb358-bf2f-4575-b5eb-45b1218feb8b None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:06.981943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:06.982584 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:06.982866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:06.983135 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:06.983877 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:06.985778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.014678 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1307/2604] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:06 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:07.019710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.030610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e6cf6-6bfd-4ddc-a19a-a97c625ba008 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.097305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.098015 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.098294 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.098566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.099280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.101833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.123657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1298/2605] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:07 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:07.128007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.138714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd07e-dbcf-4feb-9293-476785cf8ed3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.144783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.145453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.145731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.145999 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.146745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.148374 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.158788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1308/2606] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:07.162956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.173401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7ac75-5eb0-4f43-ade8-1ddcc9cfc753 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.179115 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.179758 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.180030 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.180303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.181078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.182786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b913-2fdf-435d-8973-acbeced0ce6b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.194113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1299/2607] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:07.199638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.210311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a567dd16-4ff1-492c-a471-5d5e0d8ff434 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.215183 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.216073 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.216354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.216627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] PATH_INFO: `/v3/projects/6d35ac6dbfe84e558b2ff116da55b85c/users/2945762246b846b39bb785050114083a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.233680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d35ac6dbfe84e558b2ff116da55b85c, user_id=2945762246b846b39bb785050114083a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.236451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.251704 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1309/2608] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:07 2022] PUT /identity/v3/projects/6d35ac6dbfe84e558b2ff116da55b85c/users/2945762246b846b39bb785050114083a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:07.263033 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.263325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.263735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.291266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] MFA Rules not processed for user `2945762246b846b39bb785050114083a`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:07.292550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:07.365571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1300/2609] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:51:07.371595 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.438742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b3e59-7f88-47d1-9c34-20e8461f9388 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.444087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.444765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.445048 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.445320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.446020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.447972 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.476381 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1310/2610] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:07 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:07.480504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.492501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6f0dc-9f37-4ee0-9aae-3df7ff1e1940 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.551300 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.552350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.552726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.553131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.553996 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.556019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.582681 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1301/2611] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:07 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:07.587338 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.598063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69d39a-00f6-4c21-ac86-ef86b3a283ff admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.603261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.603954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.604255 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.604528 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.605320 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.606927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.617551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1311/2612] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:07.621947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.632526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504c37b-b98b-49e0-a687-35b04b8b10ae admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.638464 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.639353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.639663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.639938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] PATH_INFO: `/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1/users/ccac0f1bac6445cc955a12d5f2e687a9/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.655561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d62c17845c740d0b2c1a2b3416a74a1, user_id=ccac0f1bac6445cc955a12d5f2e687a9, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.658222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.673256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1302/2613] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:07 2022] PUT /identity/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1/users/ccac0f1bac6445cc955a12d5f2e687a9/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:07.677413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.688028 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a8871-515e-4a10-9931-baa42e2e9df9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.754390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.755239 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.755582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.755871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.756910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.758522 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff1e94-9402-4f08-a840-320f14323771 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.768798 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1312/2614] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:07.773423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.784956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab10fa-37ec-485c-ade4-86a9d0a48469 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.790824 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.791747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.792024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.792286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] PATH_INFO: `/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1/users/ccac0f1bac6445cc955a12d5f2e687a9/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.794286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d62c17845c740d0b2c1a2b3416a74a1, user_id=ccac0f1bac6445cc955a12d5f2e687a9, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:07.796962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:07.806995 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1303/2615] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:07 2022] PUT /identity/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1/users/ccac0f1bac6445cc955a12d5f2e687a9/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:07.817803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.818189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.818468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:07.846439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] MFA Rules not processed for user `ccac0f1bac6445cc955a12d5f2e687a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:07.847662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:07.916959 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1313/2616] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:07.928763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:07.930690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:07.987619 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8e5e5-d624-41d1-a84f-fb8edd969304 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:07.991561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:07.992199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:07.992475 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:07.992746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:08.004260 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:08.006376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:08.018123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1304/2617] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:08.100943 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:08.111030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fbfcf-4608-4289-bf1e-429b5d5379de None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:08.115508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:08.116242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:08.116517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:08.116784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:08.179884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:08.181340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:08.191033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1314/2618] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:10.241729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:10.243310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:10.303038 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974f36a-42bf-4470-8539-7b9e8c736da9 service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:10.306929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:10.307620 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:10.307908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:10.308176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:10.310072 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:10.321417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:10.322852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:10.331209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1305/2619] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:53.446476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:53.448211 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:53.538121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf9830-2989-4784-843b-0b4cc7748dc5 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:53.544807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:53.545534 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:53.545882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:53.546096 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:53.548679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:53.565932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:53.567696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68980bab-ef67-499d-8c33-ccdf6074f6c0 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:53.580548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1315/2620] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:54.012122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:54.078785 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3935c3e-c124-498d-8230-ab3f6f6da745 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:54.083355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:54.084258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.084539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.084813 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] PATH_INFO: `/v3/users/2945762246b846b39bb785050114083a` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.086003 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2945762246b846b39bb785050114083a)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:54.088000 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:54.135254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2945762246b846b39bb785050114083a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.142448 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2945762246b846b39bb785050114083a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.155080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2945762246b846b39bb785050114083a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.155833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2945762246b846b39bb785050114083a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.165781 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2945762246b846b39bb785050114083a'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.172607 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1306/2621] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:51:54 2022] DELETE /identity/v3/users/2945762246b846b39bb785050114083a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:54.177607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.177890 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.178180 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.196425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:54.197621 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:54.259527 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1316/2622] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:54.268248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:54.269736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:54.330057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2f217-426a-484d-8c0b-db305ae79f6e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:54.334302 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:54.334929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.335622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.335622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.345787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:54.347234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:54.357400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1307/2623] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:54.622326 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:54.623795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:54.635894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c30439-53d1-4696-9f21-3b3a8ad41d58 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:54.641405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:54.642394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.642738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.643071 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] PATH_INFO: `/v3/projects/6d35ac6dbfe84e558b2ff116da55b85c` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.644457 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d35ac6dbfe84e558b2ff116da55b85c)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:54.646384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:54.695328 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d35ac6dbfe84e558b2ff116da55b85c', 'request_id': 'req-b9424014-bdba-42bf-82d8-6d5109d040e8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.700822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d35ac6dbfe84e558b2ff116da55b85c', 'request_id': 'req-b9424014-bdba-42bf-82d8-6d5109d040e8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.706974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d35ac6dbfe84e558b2ff116da55b85c', 'request_id': 'req-b9424014-bdba-42bf-82d8-6d5109d040e8'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.723579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] The token cache is being invalidate because project 6d35ac6dbfe84e558b2ff116da55b85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:51:54.723871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.726193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.730688 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1317/2624] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:51:54 2022] DELETE /identity/v3/projects/6d35ac6dbfe84e558b2ff116da55b85c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:54.731713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:54.741893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11414f08-486b-441d-b8fb-160b1982cbaa service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:54.800498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:54.801390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:54.801667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:54.801915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] PATH_INFO: `/v3/users/ccac0f1bac6445cc955a12d5f2e687a9` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:54.803237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccac0f1bac6445cc955a12d5f2e687a9)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:54.805200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:54.855344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccac0f1bac6445cc955a12d5f2e687a9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.863248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccac0f1bac6445cc955a12d5f2e687a9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.876032 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccac0f1bac6445cc955a12d5f2e687a9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.876990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccac0f1bac6445cc955a12d5f2e687a9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.886128 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-71c04ce3-245c-41b8-b382-fa4f683c8a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccac0f1bac6445cc955a12d5f2e687a9'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:54.892176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1308/2625] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:51:54 2022] DELETE /identity/v3/users/ccac0f1bac6445cc955a12d5f2e687a9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:55.167035 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.168749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:55.188081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9424014-bdba-42bf-82d8-6d5109d040e8 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.247212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.248147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.248617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.249088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] PATH_INFO: `/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.250351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d62c17845c740d0b2c1a2b3416a74a1)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.252796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.303624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d62c17845c740d0b2c1a2b3416a74a1', 'request_id': 'req-1440ef59-5202-4b90-9258-a97f603da7c1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:55.308854 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d62c17845c740d0b2c1a2b3416a74a1', 'request_id': 'req-1440ef59-5202-4b90-9258-a97f603da7c1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:55.315237 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d62c17845c740d0b2c1a2b3416a74a1', 'request_id': 'req-1440ef59-5202-4b90-9258-a97f603da7c1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:55.329311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] The token cache is being invalidate because project 2d62c17845c740d0b2c1a2b3416a74a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:51:55.329749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:55.330489 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1440ef59-5202-4b90-9258-a97f603da7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:55.332123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1318/2626] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:51:55 2022] DELETE /identity/v3/projects/2d62c17845c740d0b2c1a2b3416a74a1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:55.336982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.337477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.337643 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.356318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:55.357885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:55.424194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1309/2627] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:55.426021 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.426308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.426583 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.446947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:55.448181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:55.457926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1319/2628] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:55.461650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.473782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70b643-589d-4c54-8f67-148b35d18704 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.478691 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.479340 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.479659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.479934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.480654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:51:55.480951 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.482539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.494729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1310/2629] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:51:55.499324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.508416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b1e8b-0f24-4185-bcdd-fadf4a7839e5 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.516546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.517256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.517533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.517799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.518474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.520487 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.547930 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1320/2630] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:51:55.552319 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.563025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a2d8d-a842-46b2-934b-86b0080dd6b3 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.621557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.622234 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.622518 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.622800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.623632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.625552 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.646557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1311/2631] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:55.650739 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.661342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4315294-5143-466d-a614-19f1b7c5b13c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.666031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.666713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.666988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.667262 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.668026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.669674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.680329 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1321/2632] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:55.684423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.695086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3611e-5f92-4917-bca2-b4324b5c843c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.700004 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.700652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.701046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.701321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.702046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.703653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07af05e-ec79-4157-b462-e8630f45150e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.713935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1312/2633] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:51:55.718250 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.728858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ab99f-1148-4a56-a1a2-379cd2ffaafc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.734970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.735912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.736192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.736463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] PATH_INFO: `/v3/projects/1c881ee222ef440ebd3be728c09c9efd/users/c78b6b8af1e64bdab2cd5bbdbf1d59bd/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.752491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c881ee222ef440ebd3be728c09c9efd, user_id=c78b6b8af1e64bdab2cd5bbdbf1d59bd, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.755149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.770525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1322/2634] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:55 2022] PUT /identity/v3/projects/1c881ee222ef440ebd3be728c09c9efd/users/c78b6b8af1e64bdab2cd5bbdbf1d59bd/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:55.781874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.782157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.782433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.810134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] MFA Rules not processed for user `c78b6b8af1e64bdab2cd5bbdbf1d59bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:55.811533 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:55.878668 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1313/2635] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:51:55.883617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.947394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f4365-2f84-434a-b42e-ab6c523882f1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:55.952649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:55.953304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:55.953582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:55.953853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:55.954540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:55.956471 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:55.982231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1323/2636] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:55.986433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:55.997047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f29c2-9b5e-45b8-9e9b-e6e5b3cff45b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.053437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.054404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.054728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.055095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.056239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.059122 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.085786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1314/2637] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:55 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:56.089860 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:56.100612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de08b1-53e4-415d-9f7e-d3c0d0ded770 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.106632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.107292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.107609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.107965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.108653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.110260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.120938 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1324/2638] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:56.126469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:56.137623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb22813-1d6c-47ba-9693-b6c7550a0cfd admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.143797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.144662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.144915 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.145213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] PATH_INFO: `/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148/users/6c060c54acb940629e8e05d7e4078304/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.161584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35ae8a3fc2e4583a4c80aea72b1b148, user_id=6c060c54acb940629e8e05d7e4078304, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.164320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.178264 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1315/2639] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:56 2022] PUT /identity/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148/users/6c060c54acb940629e8e05d7e4078304/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:51:56.182231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:56.192307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fce7d-23fe-4eb1-b4fe-74f6d5de312c admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.259899 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.260697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.261010 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.261275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.262003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.263655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3de439-6df8-43e9-9dfb-cf16384b8eda admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.274212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1325/2640] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:56.278774 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:56.289452 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a3adb-7a24-4e8e-9d95-4544528290dd admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.295119 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.296080 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.296356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.296624 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] PATH_INFO: `/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148/users/6c060c54acb940629e8e05d7e4078304/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.298789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35ae8a3fc2e4583a4c80aea72b1b148, user_id=6c060c54acb940629e8e05d7e4078304, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.301447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.312088 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1316/2641] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:56 2022] PUT /identity/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148/users/6c060c54acb940629e8e05d7e4078304/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:56.323438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.323732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.324011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.352261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] MFA Rules not processed for user `6c060c54acb940629e8e05d7e4078304`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:56.353468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:56.426513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1326/2642] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:56.439447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:56.442435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:56.508755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9e49e-b1b7-4cbd-aad8-0d5ebc8853d8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:56.513612 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:56.514253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:56.514531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:56.514805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:56.524147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:56.525565 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31325e2b-ea23-4e45-aad1-0026a2200549 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:56.535159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1317/2643] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:56.952390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:57.021379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff6f7f-3afa-4cf2-bb42-11c952c3190d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:57.027030 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:57.027931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:57.028206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:57.028475 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] PATH_INFO: `/v3/users/c78b6b8af1e64bdab2cd5bbdbf1d59bd` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:57.029889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78b6b8af1e64bdab2cd5bbdbf1d59bd)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:57.031882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:57.080697 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78b6b8af1e64bdab2cd5bbdbf1d59bd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.093460 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78b6b8af1e64bdab2cd5bbdbf1d59bd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.100807 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78b6b8af1e64bdab2cd5bbdbf1d59bd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.101592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78b6b8af1e64bdab2cd5bbdbf1d59bd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.110305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78b6b8af1e64bdab2cd5bbdbf1d59bd'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.116288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1327/2644] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:51:56 2022] DELETE /identity/v3/users/c78b6b8af1e64bdab2cd5bbdbf1d59bd => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:57.121166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:57.121564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:57.121884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:57.140708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:57.142173 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:57.205771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1318/2645] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:51:57.216491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:57.218062 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:57.277580 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d488b6-7207-404e-9fb4-6d8e84ac5694 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:57.281971 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:57.282638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:57.282900 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:57.283170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:57.292307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:57.293756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:57.303301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1328/2646] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:57.592366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:57.593979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:57.607374 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b41dac-2538-4e4a-a564-5157d92501cd None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:57.612050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:57.612918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:57.613361 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:57.613603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] PATH_INFO: `/v3/projects/1c881ee222ef440ebd3be728c09c9efd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:57.615286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c881ee222ef440ebd3be728c09c9efd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:57.617227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:57.670280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c881ee222ef440ebd3be728c09c9efd', 'request_id': 'req-6cc85fe8-86ef-49c0-9a87-2e1593239e31'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.675630 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c881ee222ef440ebd3be728c09c9efd', 'request_id': 'req-6cc85fe8-86ef-49c0-9a87-2e1593239e31'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.681717 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c881ee222ef440ebd3be728c09c9efd', 'request_id': 'req-6cc85fe8-86ef-49c0-9a87-2e1593239e31'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.694782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] The token cache is being invalidate because project 1c881ee222ef440ebd3be728c09c9efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:51:57.695168 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.696078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.697888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1319/2647] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:51:57 2022] DELETE /identity/v3/projects/1c881ee222ef440ebd3be728c09c9efd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:57.702979 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:57.713228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c9955-000f-4b50-b9dd-33c1ab479056 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:57.772222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:57.773104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:57.773384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:57.773657 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] PATH_INFO: `/v3/users/6c060c54acb940629e8e05d7e4078304` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:57.774950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c060c54acb940629e8e05d7e4078304)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:57.776928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:57.829063 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c060c54acb940629e8e05d7e4078304'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.840790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c060c54acb940629e8e05d7e4078304'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.847745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c060c54acb940629e8e05d7e4078304'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.848556 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c060c54acb940629e8e05d7e4078304'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.857126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c060c54acb940629e8e05d7e4078304'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:57.863935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1329/2648] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:51:57 2022] DELETE /identity/v3/users/6c060c54acb940629e8e05d7e4078304 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:57.910561 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:57.912588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:57.971077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc85fe8-86ef-49c0-9a87-2e1593239e31 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.022063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.022712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.023048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.023327 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.025144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:58.089838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.091299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14222bad-6b26-468c-92ff-d2da878ec1a9 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.101174 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1320/2649] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:58.172636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.174127 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:58.188079 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71b802-3d9a-46e8-9d87-8b4b2b78d36d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.194003 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.194913 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.195190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.195496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] PATH_INFO: `/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.196811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35ae8a3fc2e4583a4c80aea72b1b148)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.198732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.257392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35ae8a3fc2e4583a4c80aea72b1b148', 'request_id': 'req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:58.263104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35ae8a3fc2e4583a4c80aea72b1b148', 'request_id': 'req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:58.269766 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35ae8a3fc2e4583a4c80aea72b1b148', 'request_id': 'req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:58.283470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] The token cache is being invalidate because project b35ae8a3fc2e4583a4c80aea72b1b148 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:51:58.283758 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:58.284363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9d974a63-7b7e-4aac-af9c-f4392dc4f2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:51:58.285903 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1330/2650] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:51:58 2022] DELETE /identity/v3/projects/b35ae8a3fc2e4583a4c80aea72b1b148 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:51:58.290921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.291223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.291532 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.308779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:58.309976 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:58.367263 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1321/2651] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:58.376235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.376523 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.376799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.394524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:58.395760 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:58.403777 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1331/2652] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:58.408076 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.418059 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbb893-64ec-4ab3-b2e4-12bfd811d4a4 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.423443 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.424110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.424390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.424662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.425392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:51:58.425695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.427321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.440154 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1322/2653] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:51:58.444542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.453984 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4903a9e1-c829-4e2d-adf3-83cc938e72ee None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.458656 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.459312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.460260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.460541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.461332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.463141 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.488703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1332/2654] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:51:58.493209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.503398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6467-c3cf-44e3-8a93-11728e7cd56c admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.558048 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.558725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.559005 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.559275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.559986 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.561923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.583022 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1323/2655] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:58.587113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.597543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cadb1-d8d7-4936-bb34-8515dad41b98 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.602324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.602982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.603260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.603579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.604339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.605947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.616379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1333/2656] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:58.620392 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.630480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a1fdb-3d6c-406b-af3e-4efb50ff6e84 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.635123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.635830 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.636112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.636387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.637113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.638707 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab008258-ed68-4395-b2ab-bd3eb18ebb2a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.648549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1324/2657] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:58.652715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.662628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca227e2-216a-4d1b-b499-cf423da39f73 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.667308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.668268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.668548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.668823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] PATH_INFO: `/v3/projects/6c3bf2fe467f425ebfac139c4fe4103e/users/aa94cded338f4ceb944ae46978c77909/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.684442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3bf2fe467f425ebfac139c4fe4103e, user_id=aa94cded338f4ceb944ae46978c77909, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.687272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.701412 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1334/2658] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:58 2022] PUT /identity/v3/projects/6c3bf2fe467f425ebfac139c4fe4103e/users/aa94cded338f4ceb944ae46978c77909/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:51:58.712006 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.712232 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.712509 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.739281 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] MFA Rules not processed for user `aa94cded338f4ceb944ae46978c77909`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:58.740655 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:58.806647 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1325/2659] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:58.811303 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.873507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad48ce-c631-4a81-a0b0-8d82045e6f15 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.878683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.879387 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.879684 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.879961 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.880650 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.882568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:58.911875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1335/2660] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:58.913622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:58.925722 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0baae5-0d7c-4c64-b65f-4912fc645b54 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:58.982461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:58.983222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:58.983544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:58.983817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:58.984504 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:58.986410 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.009881 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1326/2661] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:51:58 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:51:59.013989 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.024941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa3d21-a9ce-4d0f-bd6a-85b297732e26 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.029755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.030436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.030717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.030993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.031745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.033423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.047781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1336/2662] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:51:59.050580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.061401 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd64862-641f-456a-8d92-aec47dabc9f9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.068593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.069684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.069972 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.070249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] PATH_INFO: `/v3/projects/dba1a85e9531421987674dec290d6fde/users/a44e11133f9544e8b97fe06250e775e1/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.087347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba1a85e9531421987674dec290d6fde, user_id=a44e11133f9544e8b97fe06250e775e1, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.090141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.106704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1327/2663] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:59 2022] PUT /identity/v3/projects/dba1a85e9531421987674dec290d6fde/users/a44e11133f9544e8b97fe06250e775e1/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:51:59.110569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.120939 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10694088-30f4-4ba0-ad72-55aba9072153 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.183926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.184609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.184893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.185172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.185933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.187567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b4fe-dcf3-4ae7-bff8-8e499c34f2b9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.197712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1337/2664] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:51:59.201991 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.212487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5064e9b4-6911-4df0-a205-163d4577e211 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.217253 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.218170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.218523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.218876 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] PATH_INFO: `/v3/projects/dba1a85e9531421987674dec290d6fde/users/a44e11133f9544e8b97fe06250e775e1/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.220885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba1a85e9531421987674dec290d6fde, user_id=a44e11133f9544e8b97fe06250e775e1, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.223557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.233762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1328/2665] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:51:59 2022] PUT /identity/v3/projects/dba1a85e9531421987674dec290d6fde/users/a44e11133f9544e8b97fe06250e775e1/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:51:59.245198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.246120 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.246404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.275857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] MFA Rules not processed for user `a44e11133f9544e8b97fe06250e775e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:51:59.277168 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:59.342384 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1338/2666] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:51:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:51:59.353613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.355477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:51:59.412465 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ef92be-bcda-4c59-bb29-cbcf80a18231 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.416170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.416805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.417104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.417359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.426593 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.428117 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.437977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1329/2667] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:51:59.527871 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:51:59.542343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f04a8f-df70-465c-add8-df065c992b0d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:51:59.546611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:51:59.547827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:51:59.548115 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:51:59.548392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:51:59.608756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:51:59.610449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:51:59.620227 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1339/2668] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:51:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:01.096731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.098248 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:01.171133 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec33679-cf16-4937-b685-216b476bf71a service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.175949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.176949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.177239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.177537 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] PATH_INFO: `/v3/users/4b47d6eb074c484d8d8dd5552783d4d0` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.179010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b47d6eb074c484d8d8dd5552783d4d0)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.181241 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.235882 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b47d6eb074c484d8d8dd5552783d4d0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.245394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b47d6eb074c484d8d8dd5552783d4d0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.259733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b47d6eb074c484d8d8dd5552783d4d0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.260508 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b47d6eb074c484d8d8dd5552783d4d0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.270027 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ec1aa665-10f9-4d48-830a-7b79004f5bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b47d6eb074c484d8d8dd5552783d4d0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.276335 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1330/2669] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:01 2022] DELETE /identity/v3/users/4b47d6eb074c484d8d8dd5552783d4d0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:01.458114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.469772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece159f-ec13-4c36-af6a-e08806c945e6 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.530524 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.531513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.531737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.532012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] PATH_INFO: `/v3/projects/80373b242ff34b0ba8ac77e122566e67` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.533317 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=80373b242ff34b0ba8ac77e122566e67)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.535232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.584251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80373b242ff34b0ba8ac77e122566e67', 'request_id': 'req-afeab5e7-9e3a-4ed3-9154-4c2714022dff'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.589641 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80373b242ff34b0ba8ac77e122566e67', 'request_id': 'req-afeab5e7-9e3a-4ed3-9154-4c2714022dff'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.595940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80373b242ff34b0ba8ac77e122566e67', 'request_id': 'req-afeab5e7-9e3a-4ed3-9154-4c2714022dff'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.609946 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] The token cache is being invalidate because project 80373b242ff34b0ba8ac77e122566e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:01.610230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.610931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-afeab5e7-9e3a-4ed3-9154-4c2714022dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:01.612629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1340/2670] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:01 2022] DELETE /identity/v3/projects/80373b242ff34b0ba8ac77e122566e67 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:01.617455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.617746 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.618026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.635902 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:01.637034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:01.697204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1331/2671] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:01.705107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.705394 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.705663 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.724851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:01.726034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:01.734442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1341/2672] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:01.738855 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.748916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f5777-34a3-4988-a19c-69be851ed037 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.754834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.755601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.755879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.756146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.756874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:52:01.757205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.758798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.772626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1332/2673] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:52:01.777604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.788122 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02a7c-9fa9-482b-97fa-9a29f88242a0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.794107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.794872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.795149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.795416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.796132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.798023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.836862 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1342/2674] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:01 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:01.841913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.852529 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729a213-08ec-4481-b5c9-90aa5aaee8fe admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.911918 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.912511 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.912779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.913046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.913725 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.915657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.938186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1333/2675] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:01 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:01.944812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.960825 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a744f-b8d2-428c-8ecd-fdd38c84e487 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:01.968750 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:01.969410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:01.969733 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:01.969948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:01.970655 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:01.972275 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:01.983448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1343/2676] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:01.987639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:01.997669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c6f88-dcf6-477d-b09c-28a25754e698 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.002726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.003364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.003675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.003949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.004660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.006235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b3a30-6581-413a-b709-e3b98303ce79 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:02.016320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1334/2677] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:02.020444 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:02.030361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545f3a7-d250-4f21-bc7c-ca905c67e4f6 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.035682 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.036547 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.036822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.037091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] PATH_INFO: `/v3/projects/5ff27efad4df4cb6847ca7661fd1fc69/users/e48fbf2c16424c74bfcc240f350c3edd/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.052472 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ff27efad4df4cb6847ca7661fd1fc69, user_id=e48fbf2c16424c74bfcc240f350c3edd, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.055117 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:02.069371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1344/2678] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:02 2022] PUT /identity/v3/projects/5ff27efad4df4cb6847ca7661fd1fc69/users/e48fbf2c16424c74bfcc240f350c3edd/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:02.074563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.074853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.075140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.093550 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:02.094747 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.160019 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1335/2679] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:52:02.171269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:02.173377 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.229950 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a192e7-7b36-4873-9ef6-9433650b77bc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.234111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.234748 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.235023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.235291 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.245225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.246759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891c63f-888f-45d4-a13c-da2d8a343ee5 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:02.258104 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1345/2680] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:02.367704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:02.369299 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.381359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e932d7e-8782-4955-bdd5-2e6646b55a4d None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.386751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.387641 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.387916 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.388186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] PATH_INFO: `/v3/users/aa94cded338f4ceb944ae46978c77909` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.389423 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa94cded338f4ceb944ae46978c77909)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.391627 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:02.444988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa94cded338f4ceb944ae46978c77909'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:02.451893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa94cded338f4ceb944ae46978c77909'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:02.464925 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa94cded338f4ceb944ae46978c77909'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:02.465415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa94cded338f4ceb944ae46978c77909'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:02.473695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa94cded338f4ceb944ae46978c77909'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:02.480052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1336/2681] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:02 2022] DELETE /identity/v3/users/aa94cded338f4ceb944ae46978c77909 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:02.484800 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.485312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.485602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.503126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:02.504359 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.565483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1346/2682] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:02.582095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:02.583710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.643369 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64c914-5f13-427c-87ac-2156ae7746cc admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.648675 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.649617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.650037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.650609 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.662323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.663819 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:02.673787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1337/2683] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:02.968142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:02.970184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:02.987223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f77ae-1b32-4582-a4ab-957ad03f1497 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:02.994017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:02.995234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:02.995625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:02.995965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] PATH_INFO: `/v3/projects/6c3bf2fe467f425ebfac139c4fe4103e` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:02.997244 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3bf2fe467f425ebfac139c4fe4103e)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:02.999685 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:03.052173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3bf2fe467f425ebfac139c4fe4103e', 'request_id': 'req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.059624 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3bf2fe467f425ebfac139c4fe4103e', 'request_id': 'req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.067747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3bf2fe467f425ebfac139c4fe4103e', 'request_id': 'req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.083285 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] The token cache is being invalidate because project 6c3bf2fe467f425ebfac139c4fe4103e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:03.083625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.084288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.088915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1347/2684] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:02 2022] DELETE /identity/v3/projects/6c3bf2fe467f425ebfac139c4fe4103e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:03.090135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:03.100236 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48a2f7-1213-4edd-9ea0-f1e97bb9181b service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:03.164457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:03.165356 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:03.165663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:03.165944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] PATH_INFO: `/v3/users/a44e11133f9544e8b97fe06250e775e1` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:03.167214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44e11133f9544e8b97fe06250e775e1)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:03.169686 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:03.228705 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44e11133f9544e8b97fe06250e775e1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.235985 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44e11133f9544e8b97fe06250e775e1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.252287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44e11133f9544e8b97fe06250e775e1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.253436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44e11133f9544e8b97fe06250e775e1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.264079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-698653a2-28a3-48ca-af6c-f0027fb501ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44e11133f9544e8b97fe06250e775e1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.273706 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1338/2685] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:03 2022] DELETE /identity/v3/users/a44e11133f9544e8b97fe06250e775e1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:03.782970 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:03.784418 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:03.799881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe186bc-22d4-48c7-9825-45d0c18c7ae1 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:03.879769 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:03.880788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:03.881152 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:03.881620 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] PATH_INFO: `/v3/projects/dba1a85e9531421987674dec290d6fde` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:03.883046 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba1a85e9531421987674dec290d6fde)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:03.885214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:03.935927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba1a85e9531421987674dec290d6fde', 'request_id': 'req-ea2bd1e9-0df4-42b0-b30b-9255c249760e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.941594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba1a85e9531421987674dec290d6fde', 'request_id': 'req-ea2bd1e9-0df4-42b0-b30b-9255c249760e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.947786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba1a85e9531421987674dec290d6fde', 'request_id': 'req-ea2bd1e9-0df4-42b0-b30b-9255c249760e'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.960723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] The token cache is being invalidate because project dba1a85e9531421987674dec290d6fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:03.961018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.961633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-ea2bd1e9-0df4-42b0-b30b-9255c249760e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:03.963204 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1348/2686] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:03 2022] DELETE /identity/v3/projects/dba1a85e9531421987674dec290d6fde => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:03.968279 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:03.968583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:03.968878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:03.986680 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:03.987947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:04.047106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1339/2687] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:52:04.055572 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.055948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.056324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.075274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:04.078228 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:04.087173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1349/2688] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:04.093311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.103039 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f639dd-08d7-4f7d-bf83-b53790fcef99 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.107945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.108644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.108917 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.109182 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.109906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:52:04.110204 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.111853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.125081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1340/2689] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:52:04.129310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.138360 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200b697-3692-4a47-8140-788b6b687a0a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.143234 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.143962 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.144242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.144518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.145224 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.147189 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.174402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1350/2690] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:04.177618 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.187209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2babb8-50c3-46e9-a341-fc300d39f4b7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.241644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.242499 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.242748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.243024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.243891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.246152 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.272097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1341/2691] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:04.276509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.289731 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ef96-e163-4ce8-b5ad-7e1d57e165f5 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.295636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.297483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.297483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.297711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.298424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.300166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.315055 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1351/2692] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:04.316696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.327466 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032b23f-c5dc-4add-8808-c05f3a1c355b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.332160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.332836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.333121 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.333387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.334149 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.335799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c41a09-798e-4f57-bd4c-23a41fc6d604 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.350927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1342/2693] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:04.351942 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.368502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc467a-c3a3-4e75-81b5-a90cf3c74aff admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.373563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.374538 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.374833 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.375105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] PATH_INFO: `/v3/projects/39bd43eda29a4200a445edd673077a7c/users/2b8a8042cfda42afbdbd253e2bab807d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.392563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bd43eda29a4200a445edd673077a7c, user_id=2b8a8042cfda42afbdbd253e2bab807d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.395202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.411647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1352/2694] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:04 2022] PUT /identity/v3/projects/39bd43eda29a4200a445edd673077a7c/users/2b8a8042cfda42afbdbd253e2bab807d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:04.427556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.427843 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.428346 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.457933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] MFA Rules not processed for user `2b8a8042cfda42afbdbd253e2bab807d`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:04.459654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:04.534651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1343/2695] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:04.539316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.612155 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a488c28-d354-4ac2-8785-7e04467b5adb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.618091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.618447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.618742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.619420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.619762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.622416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.650592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1353/2696] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:52:04.654921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.666307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0238ca08-3f85-4019-82b0-feb5abf3327b None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.724835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.725522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.725859 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.727239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.727239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.735623 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.772391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1344/2697] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:04 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:04.776509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.792484 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2460411-a882-46ab-a2a9-c1767408c82b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.798330 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.799774 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.800289 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.800763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.801727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.803579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.823515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1354/2698] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:52:04.825320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.837429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc87093-04d0-4600-9f44-ea25fa362733 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:04.854613 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:04.856037 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:04.856320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:04.856597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] PATH_INFO: `/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830/users/86437b2ee9ff4d98960cf0c945957476/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:04.879900 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd76f7a923b44ef8bbd7430efe9c6830, user_id=86437b2ee9ff4d98960cf0c945957476, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:04.884368 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:04.906170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1345/2699] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:04 2022] PUT /identity/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830/users/86437b2ee9ff4d98960cf0c945957476/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:04.907521 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:04.918218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87c790-fa1d-439d-911d-a4e255903038 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:05.002208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:05.003129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:05.003638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:05.004076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:05.004954 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:05.007123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ec356-72be-4db4-a45d-64bd5e81264c admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:05.021824 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1355/2700] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:05.028381 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:05.043329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9c6c7-3cd6-48bd-b086-e0d04d12b74b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:05.049469 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:05.051283 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:05.051877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:05.052332 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] PATH_INFO: `/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830/users/86437b2ee9ff4d98960cf0c945957476/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:05.055195 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd76f7a923b44ef8bbd7430efe9c6830, user_id=86437b2ee9ff4d98960cf0c945957476, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:05.059138 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:05.073719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1346/2701] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:05 2022] PUT /identity/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830/users/86437b2ee9ff4d98960cf0c945957476/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:05.084783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:05.085403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:05.085703 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:05.115221 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] MFA Rules not processed for user `86437b2ee9ff4d98960cf0c945957476`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:05.116743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:05.193976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1356/2702] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:52:05.205978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:05.207799 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:05.282713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935da77-37f5-458d-901e-c7c36e14e2d1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:05.286898 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:05.287494 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:05.287779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:05.288051 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:05.299306 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:05.300376 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e6024-66d7-49bb-8b4b-e2186e980ae8 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:05.311188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1347/2703] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:05.359867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:05.361319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:05.374548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d1486-5e7f-4ff1-871a-72eb65109762 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:05.385197 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:05.385986 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:05.386271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:05.386545 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:05.455466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:05.457310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:05.479951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1357/2704] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:06.669715 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5939-ae93-4012-829b-7fd063e44296 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:06.670262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5939-ae93-4012-829b-7fd063e44296 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:06.670262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de5939-ae93-4012-829b-7fd063e44296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:06.698833 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-32de5939-ae93-4012-829b-7fd063e44296 None None] MFA Rules not processed for user `e48fbf2c16424c74bfcc240f350c3edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:06.700948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-32de5939-ae93-4012-829b-7fd063e44296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:06.772908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1348/2705] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:52:06.785099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:06.786635 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:06.862541 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf87f0-cee6-4b91-a9a2-caa2546ff198 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:06.868332 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:06.869004 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:06.869284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:06.869563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:06.878491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:06.880132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:06.898194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1358/2706] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:08.503147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:08.504055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:08.504481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:08.525070 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] MFA Rules not processed for user `e48fbf2c16424c74bfcc240f350c3edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:08.526708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:08.537602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1349/2707] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:08.884692 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:08.887550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:08.992249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31676bfb-d5f4-44a2-bff9-d1583574b1dc service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:08.996274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:08.997064 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:08.997348 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:08.997615 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:08.999645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.013023 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:09.014095 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:09.015796 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046002e-7808-4cb9-a488-a8e8eae589c2 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:09.033286 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1359/2708] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:09.109371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288dcf0-9409-4a2c-9652-d2ea35f74913 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:09.115097 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:09.116020 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:09.116488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:09.116762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] PATH_INFO: `/v3/users/2b8a8042cfda42afbdbd253e2bab807d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:09.119064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8a8042cfda42afbdbd253e2bab807d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:09.121720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:09.181549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8a8042cfda42afbdbd253e2bab807d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:09.190250 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8a8042cfda42afbdbd253e2bab807d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:09.202415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8a8042cfda42afbdbd253e2bab807d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:09.203254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8a8042cfda42afbdbd253e2bab807d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:09.213190 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8a8042cfda42afbdbd253e2bab807d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:09.222223 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1350/2709] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:09 2022] DELETE /identity/v3/users/2b8a8042cfda42afbdbd253e2bab807d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:09.227888 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:09.228410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:09.229006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:09.247501 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:09.248784 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.325158 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1360/2710] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:09.336947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:09.338513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.395603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:09.399324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.497067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1cf8e-2545-42b7-bcf0-f5e0ccb67571 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:09.505116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:09.511872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:09.513703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:09.514366 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:09.532161 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:09.532653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b60b-efcc-4908-bc76-81215be88815 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:09.534731 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:09.540187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:09.541193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:09.541569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:09.541920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:09.543960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.547654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1351/2711] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:52:09.560557 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:09.566020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:09.578591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1361/2712] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:09.954929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:09.956567 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:09.989078 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036d964-235e-49f4-ae94-8c8a8a8132f7 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:09.996155 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:09.997056 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:09.997330 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:09.997605 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] PATH_INFO: `/v3/projects/39bd43eda29a4200a445edd673077a7c` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:09.999171 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39bd43eda29a4200a445edd673077a7c)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:10.001481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:10.096888 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39bd43eda29a4200a445edd673077a7c', 'request_id': 'req-b3afa3be-aa68-4301-8763-c15665e810f7'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.102770 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39bd43eda29a4200a445edd673077a7c', 'request_id': 'req-b3afa3be-aa68-4301-8763-c15665e810f7'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.109166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39bd43eda29a4200a445edd673077a7c', 'request_id': 'req-b3afa3be-aa68-4301-8763-c15665e810f7'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.127570 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] The token cache is being invalidate because project 39bd43eda29a4200a445edd673077a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:10.127873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.128578 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.130231 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1352/2713] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:09 2022] DELETE /identity/v3/projects/39bd43eda29a4200a445edd673077a7c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:10.134235 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:10.145114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2037acb9-f577-4cfc-bf9d-75176fcb57df service placement] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:10.205296 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:10.206190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:10.206469 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:10.206741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] PATH_INFO: `/v3/users/86437b2ee9ff4d98960cf0c945957476` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:10.208562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86437b2ee9ff4d98960cf0c945957476)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:10.210762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:10.268012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86437b2ee9ff4d98960cf0c945957476'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.280696 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86437b2ee9ff4d98960cf0c945957476'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.287846 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86437b2ee9ff4d98960cf0c945957476'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.288676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86437b2ee9ff4d98960cf0c945957476'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.298761 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-e92b3b76-2aec-4b8d-b285-ecc35f683188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86437b2ee9ff4d98960cf0c945957476'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:10.309468 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1362/2714] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:10 2022] DELETE /identity/v3/users/86437b2ee9ff4d98960cf0c945957476 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:10.998357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:10.999946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:11.012905 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3afa3be-aa68-4301-8763-c15665e810f7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.077661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.078586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.078866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.079166 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] PATH_INFO: `/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.080839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd76f7a923b44ef8bbd7430efe9c6830)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.083082 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.131911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd76f7a923b44ef8bbd7430efe9c6830', 'request_id': 'req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:11.137212 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd76f7a923b44ef8bbd7430efe9c6830', 'request_id': 'req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:11.143343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd76f7a923b44ef8bbd7430efe9c6830', 'request_id': 'req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:11.158568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] The token cache is being invalidate because project fd76f7a923b44ef8bbd7430efe9c6830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:11.158853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:11.159634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-2b2113e8-16e9-4f6e-a5d4-6d2ca2541c48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:11.161233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1353/2715] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:10 2022] DELETE /identity/v3/projects/fd76f7a923b44ef8bbd7430efe9c6830 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:11.166439 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.166974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.166974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.187121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:11.188413 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:11.246581 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1363/2716] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:11.254753 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.256108 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.256642 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.275645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:11.276854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:11.288850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1354/2717] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:11.290098 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.299941 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbba481-7351-416d-a469-ee9178b4bf67 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.304711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.305433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.305713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.305985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.306714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:52:11.307022 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.309220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.325782 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1364/2718] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:52:11.327096 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.336479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4e937-2df9-4d3c-b2c2-6349306a2b30 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.342342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.343064 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.343344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.343654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.344378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.346343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.378761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1355/2719] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:11.380470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.391361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead9a26-db2f-44aa-98ce-1de6b27eb123 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.446746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.447343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.447654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.447932 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.448646 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.450647 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.483726 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1365/2720] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:11.488396 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.499193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be28235-6d38-4505-9f08-fa17334f29a7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.504844 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.505514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.505798 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.506074 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.506801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.508439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.522035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1356/2721] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:11.523240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.533293 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b060d-75c5-4b80-bc2b-989b8f6cca1d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.538379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.539012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.539525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.539802 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.540537 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.542175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54420bb9-2926-4d41-822b-ed7d115317f3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.553199 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1366/2722] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:11.557377 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.568286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabbd1a2-508a-4561-88fd-97e798c43589 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.574002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.574639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.574923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.575206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] PATH_INFO: `/v3/projects/b8688c7a660f491e9a5034122afe603b/users/f8f079b8391040f898cb71071c0144c0/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.592208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8688c7a660f491e9a5034122afe603b, user_id=f8f079b8391040f898cb71071c0144c0, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.595733 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.614632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1357/2723] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:11 2022] PUT /identity/v3/projects/b8688c7a660f491e9a5034122afe603b/users/f8f079b8391040f898cb71071c0144c0/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:11.626156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.626728 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.627017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.656191 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] MFA Rules not processed for user `f8f079b8391040f898cb71071c0144c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:11.657531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:11.730166 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1367/2724] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:11.732427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.794081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118f06-7ce2-4976-8a9a-acb980befed6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.799431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.800104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.800385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.800662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.801357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.803270 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.830847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1358/2725] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:11.835018 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.845898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fa219-6502-4c06-a1a2-1659d4e24a83 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.903290 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.904006 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.904284 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.904604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.905351 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.907309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.932236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1368/2726] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:11 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:52:11.934275 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.947184 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718fbc7-d333-423a-b6bb-35767046ce83 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.953580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:11.954193 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:11.954467 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:11.954734 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:11.955547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:11.957930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:11.968745 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1359/2727] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:52:11.979839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:11.993344 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd102bbf-2336-4566-bea9-73e2efe2d2d9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:11.999920 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:12.000859 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.001133 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.001461 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] PATH_INFO: `/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f/users/5a2c9c6f57984471a96c7d5f945e4908/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.018331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9385e9530e46229c8ef1ffd49fc91f, user_id=5a2c9c6f57984471a96c7d5f945e4908, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:12.021034 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:12.037117 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1369/2728] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:11 2022] PUT /identity/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f/users/5a2c9c6f57984471a96c7d5f945e4908/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:12.039806 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:12.050488 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c0b10-40ce-4739-9fb7-e7795c38f2d8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:12.118751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:12.119456 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.119800 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.119999 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.120879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:12.122674 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74c22e-fc04-4b2d-b40d-77d03d1c81ac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:12.138151 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1360/2729] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:52:12.142208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:12.153737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741b0e5-9b13-4dd2-9a02-5e63bc3b26fc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:12.159482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:12.159797 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.160075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.160340 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] PATH_INFO: `/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f/users/5a2c9c6f57984471a96c7d5f945e4908/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.162417 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9385e9530e46229c8ef1ffd49fc91f, user_id=5a2c9c6f57984471a96c7d5f945e4908, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:12.165744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:12.176499 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1370/2730] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:12 2022] PUT /identity/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f/users/5a2c9c6f57984471a96c7d5f945e4908/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:12.187522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.188116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.188574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.217498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] MFA Rules not processed for user `5a2c9c6f57984471a96c7d5f945e4908`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:12.218677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:12.286769 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1361/2731] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:12.297842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:12.299795 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:12.356449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8797f26-a877-43b8-8e18-34804f2caabb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:12.360683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:12.361336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.361614 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.361884 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.371192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:12.372794 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b8ac1-fb2b-42da-85c2-5f9e6ddd513f service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:12.382406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1371/2732] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:12 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:12.805907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:12.875233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e96d9-19f3-4745-ba6a-42d1687005b9 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:12.879772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:12.880653 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.880931 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.881205 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] PATH_INFO: `/v3/users/f8f079b8391040f898cb71071c0144c0` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.882439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f079b8391040f898cb71071c0144c0)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:12.884395 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:12.928879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f079b8391040f898cb71071c0144c0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:12.935541 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f079b8391040f898cb71071c0144c0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:12.949400 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f079b8391040f898cb71071c0144c0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:12.950183 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f079b8391040f898cb71071c0144c0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:12.958592 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f079b8391040f898cb71071c0144c0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:12.965874 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1362/2733] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:12 2022] DELETE /identity/v3/users/f8f079b8391040f898cb71071c0144c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:12.970070 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:12.970363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:12.970643 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:12.995008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:12.996274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:13.053567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1372/2734] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:13.063805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:13.065639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:13.120081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aec39f-88de-4e95-bc21-426c741c8b57 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:13.124113 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:13.124757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:13.125035 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:13.125303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:13.134450 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:13.135922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:13.145690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1363/2735] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:13.412762 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:13.414960 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:13.430080 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1266b28-e640-46a9-a296-57b5e8b0a9c2 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:13.435632 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:13.437143 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:13.437610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:13.437894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] PATH_INFO: `/v3/projects/b8688c7a660f491e9a5034122afe603b` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:13.439638 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8688c7a660f491e9a5034122afe603b)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:13.441719 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:13.491106 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8688c7a660f491e9a5034122afe603b', 'request_id': 'req-b471f310-52bb-43cc-aecb-ade1fc346e34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.496568 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8688c7a660f491e9a5034122afe603b', 'request_id': 'req-b471f310-52bb-43cc-aecb-ade1fc346e34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.505385 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8688c7a660f491e9a5034122afe603b', 'request_id': 'req-b471f310-52bb-43cc-aecb-ade1fc346e34'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.521481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] The token cache is being invalidate because project b8688c7a660f491e9a5034122afe603b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:13.521765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.522411 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.524024 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1373/2736] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:13 2022] DELETE /identity/v3/projects/b8688c7a660f491e9a5034122afe603b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:13.528150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:13.537771 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8de33-c4f1-4f13-8cde-07899a2540a8 service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:13.606067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:13.606967 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:13.607240 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:13.607534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] PATH_INFO: `/v3/users/5a2c9c6f57984471a96c7d5f945e4908` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:13.608838 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2c9c6f57984471a96c7d5f945e4908)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:13.610791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:13.660676 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2c9c6f57984471a96c7d5f945e4908'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.667403 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2c9c6f57984471a96c7d5f945e4908'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.678704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2c9c6f57984471a96c7d5f945e4908'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.679481 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2c9c6f57984471a96c7d5f945e4908'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.690180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-f3cddbb1-45cc-4003-b25f-acc15b44535a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2c9c6f57984471a96c7d5f945e4908'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:13.696167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1364/2737] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:13 2022] DELETE /identity/v3/users/5a2c9c6f57984471a96c7d5f945e4908 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:13.978645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:13.980173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:13.993300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471f310-52bb-43cc-aecb-ade1fc346e34 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.051867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.052812 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.053091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.053365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] PATH_INFO: `/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.054694 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9385e9530e46229c8ef1ffd49fc91f)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.056659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.106612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9385e9530e46229c8ef1ffd49fc91f', 'request_id': 'req-acab09d6-3a77-45ed-980a-d1a3afb9f465'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:14.112161 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9385e9530e46229c8ef1ffd49fc91f', 'request_id': 'req-acab09d6-3a77-45ed-980a-d1a3afb9f465'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:14.118995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9385e9530e46229c8ef1ffd49fc91f', 'request_id': 'req-acab09d6-3a77-45ed-980a-d1a3afb9f465'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:14.132137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] The token cache is being invalidate because project 3b9385e9530e46229c8ef1ffd49fc91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:14.132508 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:14.133212 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-acab09d6-3a77-45ed-980a-d1a3afb9f465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:14.135025 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1374/2738] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:13 2022] DELETE /identity/v3/projects/3b9385e9530e46229c8ef1ffd49fc91f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:14.139787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.140314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.140314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.157775 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:14.159052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:14.225580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1365/2739] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:14.233924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.234206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.234478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.253591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:14.254787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:14.264229 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1375/2740] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:14.268760 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.278713 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfcbae-5775-4ff1-9ba1-6c2e5aaec5a6 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.284385 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.285040 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.285320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.285594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.286320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:52:14.286626 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.288298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.300438 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1366/2741] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:52:14.304982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.314811 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a7eca-fad6-4dc2-b3ac-b95560325788 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.320788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.321455 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.321755 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.322026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.322708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.324649 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.354184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1376/2742] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:14.358759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.372457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85c300-4932-4143-9306-20504bae51d4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.445889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.446545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.446825 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.447111 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.447841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.449783 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.472147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1367/2743] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:14.476375 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.487414 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24aa96-67f4-4293-a1c0-f41828a6ecf9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.493000 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.493763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.494126 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.494403 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.495125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.496773 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.507187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1377/2744] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:14.511229 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.521325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d8863-8dc7-4358-a278-2234730cfe31 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.527086 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.527791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.528079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.528350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.529075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.530729 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73b43c-3561-40de-8466-5a7f5123d009 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.541209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1368/2745] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:52:14.545431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.555636 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b329a-0daf-4a55-86f3-a632c60161fc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.561105 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.562038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.562343 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.562616 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] PATH_INFO: `/v3/projects/f95c21ceace7433c8d9a48b79aa37a75/users/fb333cd4231c48ae99018aeaf085fe4d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.578881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95c21ceace7433c8d9a48b79aa37a75, user_id=fb333cd4231c48ae99018aeaf085fe4d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.581589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.601478 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1378/2746] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:14 2022] PUT /identity/v3/projects/f95c21ceace7433c8d9a48b79aa37a75/users/fb333cd4231c48ae99018aeaf085fe4d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:14.613012 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.613305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.613581 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.641678 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] MFA Rules not processed for user `fb333cd4231c48ae99018aeaf085fe4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:14.642879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:14.707398 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1369/2747] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:14.712283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.774473 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf241db-6c86-48bb-9a37-1f0d85b2acdd admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.779548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.780261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.780772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.781144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.781827 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.783756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.810756 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1379/2748] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:14.815422 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.827525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae71cb-5076-4cfc-9a23-1096d5e41d29 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.890903 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.891602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.891886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.892162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.892849 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.894772 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.915937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1370/2749] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:14 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:14.920241 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.931123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fcd94-da30-4fd0-a355-78ae32ed95d9 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.936225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.936887 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.937170 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.937452 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.938185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.940203 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:14.950754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1380/2750] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:14.955046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:14.965277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55620554-b0f7-4359-81a9-8ac94ec5a0c0 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:14.970973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:14.971899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:14.972177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:14.972447 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] PATH_INFO: `/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa/users/b3ee7fcd2beb436c9664a77d288cbbe3/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:14.988666 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63be4faec67448d863f1d2fbfe1e1aa, user_id=b3ee7fcd2beb436c9664a77d288cbbe3, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:14.991333 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.005732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1371/2751] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:14 2022] PUT /identity/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa/users/b3ee7fcd2beb436c9664a77d288cbbe3/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:15.009781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:15.020137 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dada6e9-403e-4ef2-98e8-f8557e9dd8ba admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:15.077014 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:15.077680 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.077982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.078240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.078985 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:15.080603 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7fc9-aabb-4160-98de-d26d7a29d2c7 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.090258 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1381/2752] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:15.095708 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:15.110784 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d144ac7-7a62-4606-93bf-8f7bf164892e admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:15.115936 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:15.116847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.117123 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.117393 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] PATH_INFO: `/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa/users/b3ee7fcd2beb436c9664a77d288cbbe3/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.119359 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63be4faec67448d863f1d2fbfe1e1aa, user_id=b3ee7fcd2beb436c9664a77d288cbbe3, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:15.122046 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.134092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1372/2753] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:15 2022] PUT /identity/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa/users/b3ee7fcd2beb436c9664a77d288cbbe3/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:15.144924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.145192 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.145458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.173300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] MFA Rules not processed for user `b3ee7fcd2beb436c9664a77d288cbbe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:15.174493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:15.244683 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1382/2754] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:15.256860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:15.258887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:15.314908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f832cd-e389-45ec-8b3b-0b65c77d3386 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:15.318930 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:15.319603 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.319886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.320162 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.329325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:15.330700 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.339853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1373/2755] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:15.411322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:15.421937 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f0412-a802-4132-bb7a-9e3c15625f46 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:15.426653 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:15.427304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.427613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.427885 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.494666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:15.496157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc772b4-879f-48c4-8d65-5863ed20667f service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.504921 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1383/2756] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:15.777021 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:15.840068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d55d2-fb4d-4816-a577-cd5569c4a867 service cinder] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:15.844631 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:15.845514 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.845787 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.846057 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] PATH_INFO: `/v3/users/fb333cd4231c48ae99018aeaf085fe4d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.847247 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb333cd4231c48ae99018aeaf085fe4d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:15.849201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:15.897107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb333cd4231c48ae99018aeaf085fe4d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:15.903923 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb333cd4231c48ae99018aeaf085fe4d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:15.916404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb333cd4231c48ae99018aeaf085fe4d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:15.917192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb333cd4231c48ae99018aeaf085fe4d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:15.926606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb333cd4231c48ae99018aeaf085fe4d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:15.933106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1374/2757] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:15 2022] DELETE /identity/v3/users/fb333cd4231c48ae99018aeaf085fe4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:15.938032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:15.938352 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:15.938630 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:15.957858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:15.959052 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:16.018297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1384/2758] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:52:16.029213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:16.030841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:16.090188 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4ca34-3635-479a-ba5e-27e549d902f9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:16.094736 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:16.095397 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:16.095765 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:16.096031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:16.106239 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:16.107748 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:16.117837 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1375/2759] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:16.397341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:16.398781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:16.412481 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94631dde-0f69-4b21-899d-a65a6f7f461d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:16.417392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:16.418396 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:16.419194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:16.419686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] PATH_INFO: `/v3/projects/f95c21ceace7433c8d9a48b79aa37a75` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:16.421242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95c21ceace7433c8d9a48b79aa37a75)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:16.423261 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:16.473465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95c21ceace7433c8d9a48b79aa37a75', 'request_id': 'req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.478947 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95c21ceace7433c8d9a48b79aa37a75', 'request_id': 'req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.485325 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95c21ceace7433c8d9a48b79aa37a75', 'request_id': 'req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.499171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] The token cache is being invalidate because project f95c21ceace7433c8d9a48b79aa37a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:16.499849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.500123 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.501668 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1385/2760] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:16 2022] DELETE /identity/v3/projects/f95c21ceace7433c8d9a48b79aa37a75 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:16.505650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:16.515298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923bd63-a0de-4169-a8dd-cdb4154588ce service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:16.574159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:16.575028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:16.575314 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:16.575621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] PATH_INFO: `/v3/users/b3ee7fcd2beb436c9664a77d288cbbe3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:16.578937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ee7fcd2beb436c9664a77d288cbbe3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:16.580899 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:16.630588 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ee7fcd2beb436c9664a77d288cbbe3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.636941 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ee7fcd2beb436c9664a77d288cbbe3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.648885 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ee7fcd2beb436c9664a77d288cbbe3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.649635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ee7fcd2beb436c9664a77d288cbbe3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.659266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-d2cc14bf-6909-4aa6-b003-c39f1245fc5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ee7fcd2beb436c9664a77d288cbbe3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:16.665114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1376/2761] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:16 2022] DELETE /identity/v3/users/b3ee7fcd2beb436c9664a77d288cbbe3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:16.960357 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:16.961988 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:16.975861 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5501f1c-7ee6-4d79-afb3-c27e8325e4d4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.032863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.033725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.034144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.034424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] PATH_INFO: `/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.035765 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63be4faec67448d863f1d2fbfe1e1aa)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.037658 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.088856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63be4faec67448d863f1d2fbfe1e1aa', 'request_id': 'req-b6baad29-2265-48ea-a829-5f5329cafa37'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:17.094923 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63be4faec67448d863f1d2fbfe1e1aa', 'request_id': 'req-b6baad29-2265-48ea-a829-5f5329cafa37'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:17.101437 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63be4faec67448d863f1d2fbfe1e1aa', 'request_id': 'req-b6baad29-2265-48ea-a829-5f5329cafa37'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:17.118633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] The token cache is being invalidate because project b63be4faec67448d863f1d2fbfe1e1aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:17.118904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:17.119606 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-b6baad29-2265-48ea-a829-5f5329cafa37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:17.121193 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1386/2762] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:16 2022] DELETE /identity/v3/projects/b63be4faec67448d863f1d2fbfe1e1aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:17.126835 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.127134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.127645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.146804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:17.148009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:17.211055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1377/2763] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:17.220202 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.220485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.220757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.238907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:17.240177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:17.248742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1387/2764] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:17.253114 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.262937 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e48f51c-756f-4d12-8d89-76d47dac2d1a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.267980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.268672 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.268945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.269216 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.269963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:52:17.270269 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.271887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.283549 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1378/2765] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:52:17.287914 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.297249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01255dc-758d-4df2-bd28-46833f65d560 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.303214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.303940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.304213 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.304466 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.305147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.307091 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.335184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1388/2766] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:52:17 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:17.339322 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.349342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b93d2-38fb-48a9-9439-56d7e0dd1002 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.406325 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.406919 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.407200 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.407582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.408296 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.410208 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.430493 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1379/2767] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:52:17 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:52:17.434617 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.446316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c94a9b-1414-437a-9530-c820f671d44e admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.451714 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.452526 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.452805 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.453078 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.453809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.455404 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.466038 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1389/2768] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:17.470192 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.480042 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ebdd9-feef-4209-b91e-835ddfca8750 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.485479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.486255 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.486534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.486826 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.487583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.489233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58188d10-1319-4d6f-b367-ce7dbc08e136 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.500656 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1380/2769] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:52:17.504918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.516509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ff1ac-f1b2-485f-a36f-137082e3fa5f admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.521842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.522785 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.523341 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.523792 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] PATH_INFO: `/v3/projects/1519829e6d4a4ecc8be2e2a52d3c6a29/users/bab723609d2e458cba2293c509800f1d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.538449 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1519829e6d4a4ecc8be2e2a52d3c6a29, user_id=bab723609d2e458cba2293c509800f1d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.541240 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.556353 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1390/2770] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:52:17 2022] PUT /identity/v3/projects/1519829e6d4a4ecc8be2e2a52d3c6a29/users/bab723609d2e458cba2293c509800f1d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:52:17.624980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.625525 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.625687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.653435 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] MFA Rules not processed for user `bab723609d2e458cba2293c509800f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:17.654694 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:17.716742 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1381/2771] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:17.727996 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:17.730031 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:17.787519 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be1e9e-d6ab-4f5c-815b-44fd23fc7a79 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:17.791511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:17.792159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:17.792436 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:17.792715 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:17.801342 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:17.802776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:17.816077 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1391/2772] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:19.514244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:19.516052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:19.595008 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab2d29-8553-4ec8-99a6-22c3ab3ce222 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:19.600947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:19.601602 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:19.601883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:19.602157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:19.604110 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:19.616256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:19.617873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e24e4-8051-498c-83f9-3a447f3961ea service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:19.628291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1382/2773] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:20.385948 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:20.457118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b096ab3-e9ec-4f35-b931-f0213b147c8b service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:20.462288 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:20.463167 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:20.463465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:20.463742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] PATH_INFO: `/v3/users/bab723609d2e458cba2293c509800f1d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:20.464982 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab723609d2e458cba2293c509800f1d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:20.466895 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:20.517313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab723609d2e458cba2293c509800f1d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:20.529336 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab723609d2e458cba2293c509800f1d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:20.538231 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab723609d2e458cba2293c509800f1d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:20.539033 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab723609d2e458cba2293c509800f1d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:20.549066 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab723609d2e458cba2293c509800f1d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:20.557839 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1392/2774] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:52:20 2022] DELETE /identity/v3/users/bab723609d2e458cba2293c509800f1d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:20.562646 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:20.563135 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:20.563245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:20.581458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:52:20.582632 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:20.643877 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1383/2775] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:52:20.653974 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:20.655592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:20.715305 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb497ca-bdb7-4045-9fdc-295aece8041b admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:20.719504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:20.720147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:20.720433 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:20.720708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:20.730822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:20.732287 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:20.741881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1393/2776] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:52:21.019092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:21.020563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:21.032576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b22f85-2c2a-4220-89af-5bcb4387516a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:21.037547 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:21.038409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:21.038683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:21.038953 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] PATH_INFO: `/v3/projects/1519829e6d4a4ecc8be2e2a52d3c6a29` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:21.040311 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1519829e6d4a4ecc8be2e2a52d3c6a29)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:21.042353 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:21.092191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1519829e6d4a4ecc8be2e2a52d3c6a29', 'request_id': 'req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:21.098178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1519829e6d4a4ecc8be2e2a52d3c6a29', 'request_id': 'req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:21.104427 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1519829e6d4a4ecc8be2e2a52d3c6a29', 'request_id': 'req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:21.117568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] The token cache is being invalidate because project 1519829e6d4a4ecc8be2e2a52d3c6a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:52:21.117857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:21.118498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:52:21.120127 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1384/2777] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:52:21 2022] DELETE /identity/v3/projects/1519829e6d4a4ecc8be2e2a52d3c6a29 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:52:58.647249 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:52:58.683100 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b433e-4d26-4113-8105-7a630d15d9b2 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:52:58.729177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:52:58.729910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:52:58.730184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:52:58.730456 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:52:58.732467 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:52:58.834799 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:52:58.836376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:52:58.854609 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1394/2778] 10.222.0.23 () {60 vars in 1396 bytes} [Wed May 4 21:52:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3246 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:09.011924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:09.013576 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:09.137569 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece44b48-c82f-4e94-83e7-5b84fd5abaa8 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:09.143850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:09.144505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:09.144793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:09.145067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:09.146977 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:09.158704 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:09.160328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:09.170318 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1385/2779] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:53:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:11.488401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:11.489751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:11.513915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd52f4-842e-4e5a-9c2a-b1481f7e67c7 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:11.518005 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:11.519200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:11.519517 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:11.519819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:11.521823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:11.608993 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:11.610510 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:11.629549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1395/2780] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:53:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:53:18.125589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:18.127222 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:18.143889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de675-6b08-4a55-9f4b-f300703f3949 service placement] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:18.149213 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:18.150116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:18.150390 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:18.150657 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] PATH_INFO: `/v3/users/4659bfb748294775b81b1dff3e77c5f8` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:18.151956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4659bfb748294775b81b1dff3e77c5f8)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:18.153920 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:18.202497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4659bfb748294775b81b1dff3e77c5f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.209841 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4659bfb748294775b81b1dff3e77c5f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.223196 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4659bfb748294775b81b1dff3e77c5f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.223955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4659bfb748294775b81b1dff3e77c5f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.232671 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4659bfb748294775b81b1dff3e77c5f8'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.240990 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1386/2781] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:53:18 2022] DELETE /identity/v3/users/4659bfb748294775b81b1dff3e77c5f8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:53:18.429565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:18.440009 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281af0b-4524-4a1c-878b-94453dc6c86c service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:18.502331 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:18.503195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:18.503502 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:18.503772 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] PATH_INFO: `/v3/projects/ee66d81ea92041cab173ee39d2929456` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:18.504925 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee66d81ea92041cab173ee39d2929456)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:18.506835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:18.554129 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee66d81ea92041cab173ee39d2929456', 'request_id': 'req-9eb047b3-795a-41a5-8ed7-edd27984e952'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.559304 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee66d81ea92041cab173ee39d2929456', 'request_id': 'req-9eb047b3-795a-41a5-8ed7-edd27984e952'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.565196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee66d81ea92041cab173ee39d2929456', 'request_id': 'req-9eb047b3-795a-41a5-8ed7-edd27984e952'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.579295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] The token cache is being invalidate because project ee66d81ea92041cab173ee39d2929456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:53:18.579613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.580205 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.581738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1396/2782] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:53:18 2022] DELETE /identity/v3/projects/ee66d81ea92041cab173ee39d2929456 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:53:18.585850 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:18.587316 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:18.600542 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ee055-c5dd-4904-98e3-af8c1616abf4 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:18.664414 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:18.665502 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:18.665862 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:18.666233 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] PATH_INFO: `/v3/users/86a1904bef4e4449bbc214d351f263c1` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:18.682527 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a1904bef4e4449bbc214d351f263c1)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:18.684544 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:18.737077 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a1904bef4e4449bbc214d351f263c1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.743730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a1904bef4e4449bbc214d351f263c1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.755313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a1904bef4e4449bbc214d351f263c1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.756028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a1904bef4e4449bbc214d351f263c1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.766147 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-9da72ab1-79a8-418d-819d-81fa8a19a098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a1904bef4e4449bbc214d351f263c1'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:18.772342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1387/2783] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:53:18 2022] DELETE /identity/v3/users/86a1904bef4e4449bbc214d351f263c1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:53:18.946488 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:18.947969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:18.960530 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb047b3-795a-41a5-8ed7-edd27984e952 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:19.015397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:19.016256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:19.016561 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:19.016832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] PATH_INFO: `/v3/projects/73893551e77c46849e05b827694b1030` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:19.026781 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73893551e77c46849e05b827694b1030)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:19.028741 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:19.074582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73893551e77c46849e05b827694b1030', 'request_id': 'req-fce758cd-7fcf-4524-9c76-b14dab067316'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:19.079737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73893551e77c46849e05b827694b1030', 'request_id': 'req-fce758cd-7fcf-4524-9c76-b14dab067316'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:19.086001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73893551e77c46849e05b827694b1030', 'request_id': 'req-fce758cd-7fcf-4524-9c76-b14dab067316'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:19.099738 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] The token cache is being invalidate because project 73893551e77c46849e05b827694b1030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:53:19.100013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:19.100613 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:53:19.102131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1397/2784] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:53:18 2022] DELETE /identity/v3/projects/73893551e77c46849e05b827694b1030 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:53:49.672622 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:49.673220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:49.673220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:49.691336 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] MFA Rules not processed for user `e48fbf2c16424c74bfcc240f350c3edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:53:49.692935 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:49.748832 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1388/2785] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:53:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:53:50.064757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:53:50.066429 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:50.121548 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce758cd-7fcf-4524-9c76-b14dab067316 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:53:50.125503 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:53:50.126144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:53:50.126424 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:53:50.126700 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:53:50.128763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:53:50.138789 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:53:50.140269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:53:50.148420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1398/2786] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:53:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:54:02.173912 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:54:02.175492 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:54:02.275304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3760f-639a-4b60-b010-8231ca2096d7 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:54:02.281853 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:54:02.282505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:54:02.282782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:54:02.283049 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:54:02.284886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:54:02.296589 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:54:02.298140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:54:02.308801 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1389/2787] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:54:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:55:17.597119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:55:17.598706 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:55:17.680911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187a5e0-2274-453a-89fb-c4a7a6094717 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:55:17.685787 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:55:17.686434 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:55:17.686710 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:55:17.686980 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:55:17.689347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:55:17.704747 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:55:17.706184 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93727bf-a542-40be-b2cb-7328d128fb6f service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:55:17.717198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1399/2788] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:55:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:55:19.131486 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:55:19.133287 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:55:19.145170 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3495f-fedb-4ba7-97a0-6257aa6f5145 service nova] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:55:19.149014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:55:19.149662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:55:19.149943 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:55:19.150202 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:55:19.152140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:55:19.166206 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:55:19.168026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:55:19.179355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1390/2789] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:55:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:55:29.362763 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:55:29.363408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:55:29.363408 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:55:29.381912 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] MFA Rules not processed for user `e48fbf2c16424c74bfcc240f350c3edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:55:29.383111 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:55:29.390874 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1400/2790] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:55:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:56:15.246187 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:56:15.255557 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073941-f195-4994-ad1a-fdf8910e07eb service neutron] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:56:15.260125 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:56:15.260789 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:56:15.261067 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:56:15.261338 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:56:15.263505 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:56:15.273710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:56:15.275153 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80a2fb-5625-4088-ab2e-c1da4f0eb518 service neutron] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:56:15.283370 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1391/2791] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:56:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:57:01.344146 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:01.357549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3080b70e-194f-4c94-b678-ffcf2c8cf648 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:01.364376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:01.367017 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:01.367659 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:01.368085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:01.370926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:57:01.385816 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:01.387518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:01.399813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1401/2792] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:57:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 04 21:57:04.395016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:04.395571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:04.395571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:04.413788 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] MFA Rules not processed for user `e48fbf2c16424c74bfcc240f350c3edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:57:04.414968 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:57:04.424658 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1392/2793] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:57:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:57:07.227848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:57:07.229354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:57:07.243592 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19e022-b762-4e42-b913-deeb380c7858 service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:57:07.250664 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0916e52c6c48499588ca68d970588ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:57:07.251515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:57:07.252065 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:57:07.252628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:57:07.255054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:57:07.266496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:57:07.268267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:57:07.278778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1402/2794] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:57:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:10.776924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:10.778803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:10.853944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443d3f1-d606-4bed-ae21-9a812a78f682 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:10.860066 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:10.860766 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:10.861079 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:10.861411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:10.863454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:10.877628 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:10.879252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:10.889429 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1393/2795] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:49.979679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:49.989856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bbbb12-c508-4f62-8b5b-32bd2d2eb50e service nova] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:49.994383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:49.995020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:49.995300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:49.995675 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:49.997849 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:50.062667 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:50.064142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:50.074566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1403/2796] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:53.298595 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:53.300852 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:53.320893 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b9ec0-506b-4e71-99af-71e00276619f service placement] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:53.325621 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:53.326497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.326778 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.327054 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] PATH_INFO: `/v3/users/e48fbf2c16424c74bfcc240f350c3edd` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.328341 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48fbf2c16424c74bfcc240f350c3edd)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:53.330249 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:53.382763 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48fbf2c16424c74bfcc240f350c3edd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.390695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48fbf2c16424c74bfcc240f350c3edd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.403604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48fbf2c16424c74bfcc240f350c3edd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.404371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48fbf2c16424c74bfcc240f350c3edd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.413357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-457215a6-ce6b-4072-a137-cba038b6f5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48fbf2c16424c74bfcc240f350c3edd'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.419540 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1394/2797] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:58:53 2022] DELETE /identity/v3/users/e48fbf2c16424c74bfcc240f350c3edd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:53.593232 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:53.603842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560cfec-f36a-4ce4-a450-dae2e7932539 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:53.668121 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:53.669012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.669292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.669563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] PATH_INFO: `/v3/projects/5ff27efad4df4cb6847ca7661fd1fc69` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.670743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ff27efad4df4cb6847ca7661fd1fc69)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:53.672681 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:53.721147 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ff27efad4df4cb6847ca7661fd1fc69', 'request_id': 'req-547d8c85-7775-4b26-80a3-8d43b724ea3b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.727134 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ff27efad4df4cb6847ca7661fd1fc69', 'request_id': 'req-547d8c85-7775-4b26-80a3-8d43b724ea3b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.733627 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ff27efad4df4cb6847ca7661fd1fc69', 'request_id': 'req-547d8c85-7775-4b26-80a3-8d43b724ea3b'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.747751 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] The token cache is being invalidate because project 5ff27efad4df4cb6847ca7661fd1fc69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80011) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:58:53.748042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.748708 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-547d8c85-7775-4b26-80a3-8d43b724ea3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:53.750431 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1404/2798] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:58:53 2022] DELETE /identity/v3/projects/5ff27efad4df4cb6847ca7661fd1fc69 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:53.756405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.756687 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.756963 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.813254 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:53.814461 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:53.872730 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1395/2799] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:53.881910 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.882200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.882496 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.902560 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:53.903809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:53.912841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1405/2800] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:53.917313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:53.927140 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d549c-1456-49a1-832e-1f5728dfc371 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:53.932436 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:53.933157 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.933417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.933684 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.934411 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80010) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:58:53.934719 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:53.936364 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:53.948566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1396/2801] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 04 21:58:53.953072 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:53.962292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5515965d-a5f6-409c-8f25-a7cc51d993f0 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:53.967282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:53.967945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:53.968222 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:53.968494 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:53.969177 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:53.971075 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.007743 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1406/2802] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:58:53 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:58:54.012014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.022002 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666a736-3ee5-4772-a44f-a499b06b4d34 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.083428 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.084107 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.084384 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.084644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.085342 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.087261 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.112217 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1397/2803] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:58:54 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:58:54.116448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.127190 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f97aa9f-c7f7-46f5-b1ef-0ae94c2055b4 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.132013 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.132671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.132951 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.133225 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.133956 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.135582 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.145543 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1407/2804] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:58:54.149644 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.160106 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b5196f-9c75-4c3e-8ffe-e2621a72f8e7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.165228 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.165944 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.166197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.166478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.167198 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.168867 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bf6af-ee4d-41f2-9c5d-4089cdb492ff admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.179126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1398/2805] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:58:54.183194 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.193666 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2c8f2-c913-4b40-b9d8-efed983640cc admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.200023 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.200894 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.201174 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.201447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] PATH_INFO: `/v3/projects/f313672ec0864681b707caeaea6b9c55/users/266b271d28174943967f5e2050c9e929/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.217307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f313672ec0864681b707caeaea6b9c55, user_id=266b271d28174943967f5e2050c9e929, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.219995 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.235973 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1408/2806] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:54 2022] PUT /identity/v3/projects/f313672ec0864681b707caeaea6b9c55/users/266b271d28174943967f5e2050c9e929/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:54.246454 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.246794 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.247073 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.274394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] MFA Rules not processed for user `266b271d28174943967f5e2050c9e929`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:54.275573 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:54.347582 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1399/2807] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:54.352298 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.413230 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c4bec-887f-4cb8-881f-201943146821 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.418594 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.419238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.419544 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.419815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.420483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.422397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.451210 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1409/2808] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:58:54 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:58:54.455197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.465577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2805bf9-3cdb-4e29-bb98-bb5cc982f3aa None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.534872 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.535480 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.535757 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.536031 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.536752 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.538702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.564577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1400/2809] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:58:54 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:58:54.570567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.581513 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c96254-e302-419e-a7f4-7fdbb0258535 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.587856 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.588515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.588790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.589058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.589863 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.591500 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.602416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1410/2810] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:58:54.606519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.616854 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8118f99-544c-409b-bdf0-d72619ca9fe6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.622583 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.623500 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.623786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.624061 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] PATH_INFO: `/v3/projects/ce2b008d7bb8495faa55926f15808338/users/6bcc6e1b4ad440ffa335c4cb36636827/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.640334 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2b008d7bb8495faa55926f15808338, user_id=6bcc6e1b4ad440ffa335c4cb36636827, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.643029 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.659521 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1401/2811] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:54 2022] PUT /identity/v3/projects/ce2b008d7bb8495faa55926f15808338/users/6bcc6e1b4ad440ffa335c4cb36636827/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:54.664196 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.678076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdaee8b-8f14-4df9-8d7c-7226084aca01 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.741597 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.742520 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.742875 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.743172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.744300 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.746525 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb692c-54e1-4287-8f6d-598515032c73 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.761511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1411/2812] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:58:54.765709 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.776024 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247abaff-1f6f-49ed-ab46-1dcc909e32a6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.781007 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.781884 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.782167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.782442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] PATH_INFO: `/v3/projects/ce2b008d7bb8495faa55926f15808338/users/6bcc6e1b4ad440ffa335c4cb36636827/roles/1af302468b924833a9aea028857eac8d` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.784478 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2b008d7bb8495faa55926f15808338, user_id=6bcc6e1b4ad440ffa335c4cb36636827, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:54.787167 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:54.797220 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1402/2813] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:54 2022] PUT /identity/v3/projects/ce2b008d7bb8495faa55926f15808338/users/6bcc6e1b4ad440ffa335c4cb36636827/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:54.807540 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.807822 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.808094 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:54.836604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] MFA Rules not processed for user `6bcc6e1b4ad440ffa335c4cb36636827`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:54.837965 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:54.918518 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1412/2814] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:54.929883 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:54.932034 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:54.993553 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a570f-fe76-4777-ae08-9678ab103c03 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:54.998548 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:54.999194 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:54.999522 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:54.999804 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:55.010857 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:55.012424 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a332218-9098-40f5-aead-c1b14a211d23 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:55.022238 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1403/2815] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:56.398278 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:56.472036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f418deb-f137-41eb-a6fc-72c7aa76970a None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:56.477416 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:56.478279 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:56.478553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:56.479969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] PATH_INFO: `/v3/users/266b271d28174943967f5e2050c9e929` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:56.481209 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=266b271d28174943967f5e2050c9e929)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:56.483118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:56.536479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266b271d28174943967f5e2050c9e929'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:56.549008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266b271d28174943967f5e2050c9e929'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:56.555778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266b271d28174943967f5e2050c9e929'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:56.556555 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266b271d28174943967f5e2050c9e929'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:56.566020 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266b271d28174943967f5e2050c9e929'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:56.573886 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1413/2816] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:58:56 2022] DELETE /identity/v3/users/266b271d28174943967f5e2050c9e929 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:56.578649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:56.579144 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:56.579245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:56.597714 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:56.598848 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:56.664611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1404/2817] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:56.674566 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:56.676254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:56.745113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0a81e-0c8e-499a-8b45-faae5038d09d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:56.749998 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:56.750651 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:56.750958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:56.751208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:56.761410 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:56.762881 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:56.774485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1414/2818] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:57.059551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:57.061085 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:57.075974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711d665-78b3-41cd-9a18-074839064f5f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:57.080743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:57.081633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.081904 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.082197 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] PATH_INFO: `/v3/projects/f313672ec0864681b707caeaea6b9c55` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.083323 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f313672ec0864681b707caeaea6b9c55)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:57.085352 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:57.134617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f313672ec0864681b707caeaea6b9c55', 'request_id': 'req-4f639a77-4092-44c2-8ed9-e7a4a8984798'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.140572 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f313672ec0864681b707caeaea6b9c55', 'request_id': 'req-4f639a77-4092-44c2-8ed9-e7a4a8984798'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.147050 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f313672ec0864681b707caeaea6b9c55', 'request_id': 'req-4f639a77-4092-44c2-8ed9-e7a4a8984798'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.160866 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] The token cache is being invalidate because project f313672ec0864681b707caeaea6b9c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:58:57.161150 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.161761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.163290 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1405/2819] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:58:57 2022] DELETE /identity/v3/projects/f313672ec0864681b707caeaea6b9c55 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:57.167425 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:57.177215 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ce166-80fa-42b8-94bc-7803167ac5c8 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:57.244283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:57.245169 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.245454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.245753 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] PATH_INFO: `/v3/users/6bcc6e1b4ad440ffa335c4cb36636827` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.247866 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bcc6e1b4ad440ffa335c4cb36636827)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:57.250629 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:57.301142 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bcc6e1b4ad440ffa335c4cb36636827'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.312319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bcc6e1b4ad440ffa335c4cb36636827'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.321511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bcc6e1b4ad440ffa335c4cb36636827'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.322307 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bcc6e1b4ad440ffa335c4cb36636827'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.331737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c5e3fc41-43a2-4575-9c55-d6e5a2a9de16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bcc6e1b4ad440ffa335c4cb36636827'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.337806 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1415/2820] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:58:57 2022] DELETE /identity/v3/users/6bcc6e1b4ad440ffa335c4cb36636827 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 04 21:58:57.629750 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:57.631243 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:57.645934 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f639a77-4092-44c2-8ed9-e7a4a8984798 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:57.708993 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:57.710036 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.710351 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.710702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] PATH_INFO: `/v3/projects/ce2b008d7bb8495faa55926f15808338` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.712688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2b008d7bb8495faa55926f15808338)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:57.714754 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:57.767596 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2b008d7bb8495faa55926f15808338', 'request_id': 'req-92365448-2655-4f59-931f-7f513af69fbf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.774245 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2b008d7bb8495faa55926f15808338', 'request_id': 'req-92365448-2655-4f59-931f-7f513af69fbf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.780829 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2b008d7bb8495faa55926f15808338', 'request_id': 'req-92365448-2655-4f59-931f-7f513af69fbf'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.795501 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] The token cache is being invalidate because project ce2b008d7bb8495faa55926f15808338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:58:57.795782 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.796513 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-92365448-2655-4f59-931f-7f513af69fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:58:57.798252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1406/2821] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:58:57 2022] DELETE /identity/v3/projects/ce2b008d7bb8495faa55926f15808338 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:57.803405 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.803907 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.804016 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.822195 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:57.823432 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:57.885339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1416/2822] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:57.893580 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.893878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.894126 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.913016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:57.914214 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:57.922933 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1407/2823] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:57.927173 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:57.937321 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c916e5-4112-424c-b269-d8aee5c81472 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:57.943233 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:57.943940 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.944218 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.944485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.945562 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:58:57.945867 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:57.947504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:57.959654 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1417/2824] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:58:57.963873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:57.973224 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b0818-7d0b-4fac-8738-fe4549ab0d7f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:57.978880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:57.979571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:57.979901 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:57.980175 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:57.980860 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:57.982817 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.011610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1408/2825] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:58:57 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:58:58.015679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.025430 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480876e-d7eb-4773-9f07-4d98efd1ba74 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.083185 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.083911 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.084187 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.084453 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.085172 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.087089 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.112744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1418/2826] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:58:58 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:58:58.117063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.127836 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403244e-d82c-431d-a989-4a84e1e5c8be admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.132847 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.133498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.133777 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.134092 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.134807 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.136430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.147551 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1409/2827] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:58:58.151803 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.162093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2745-4d72-49fc-9f18-e665a9372a1f admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.167154 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.167844 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.168119 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.168390 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.169118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.170711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a15ad6-2883-42d9-bc2c-bc75ea96ad7d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.180486 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1419/2828] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:58:58.184759 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.195011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77031cdd-2eb4-4960-8079-768e1a547caf admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.200723 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.201594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.201873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.202143 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] PATH_INFO: `/v3/projects/94d58d0689814379afbef301dc521068/users/121c5747a0a040b7a27f0d43ec2efc2d/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.217331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d58d0689814379afbef301dc521068, user_id=121c5747a0a040b7a27f0d43ec2efc2d, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.219938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.238809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1410/2829] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:58 2022] PUT /identity/v3/projects/94d58d0689814379afbef301dc521068/users/121c5747a0a040b7a27f0d43ec2efc2d/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:58.249717 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.250001 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.250274 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.277878 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] MFA Rules not processed for user `121c5747a0a040b7a27f0d43ec2efc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:58.279073 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:58.346171 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1420/2830] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:58:58.350732 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.410328 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ba69-3a97-4451-8fa0-fbfc8bfe237b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.415497 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.416159 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.416440 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.416712 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.417415 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.419343 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.448743 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1411/2831] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:58:58 2022] POST /identity/v3/projects => generated 399 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 04 21:58:58.453131 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.465086 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb82d5-01d2-4f58-b67e-d7d733184d50 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.528372 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.529313 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.530118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.530679 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.531371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.534316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.563786 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1421/2832] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:58:58 2022] POST /identity/v3/users => generated 306 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:58:58.565577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.577262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca973ae-eca4-4743-bfa3-09ad8db75db6 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.582639 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.583298 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.583633 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.583906 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.584654 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.586280 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.596965 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1412/2833] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:58:58.601139 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.611276 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ab6cc-817c-45bc-90c0-d40d867a42e6 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.616308 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.617186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.617463 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.617734 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] PATH_INFO: `/v3/projects/96d3221aafc248b7817b5069bc94bdfc/users/7bd770f3a6d1460ca386dabbb852f2a7/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.633465 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d3221aafc248b7817b5069bc94bdfc, user_id=7bd770f3a6d1460ca386dabbb852f2a7, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.636253 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.651186 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1422/2834] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:58 2022] PUT /identity/v3/projects/96d3221aafc248b7817b5069bc94bdfc/users/7bd770f3a6d1460ca386dabbb852f2a7/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:58.655235 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.665262 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea115-3d78-4354-8ca4-64032fca84d9 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.724052 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.724720 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.725010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.725291 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.726011 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.727650 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b11742-bb3d-4ca7-bc9c-a095c80367d5 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.737433 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1413/2835] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:58:58.741926 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.752819 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b041c8-878e-4722-9c19-2c5abd5aff0d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.758242 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.759144 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.759482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.759757 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] PATH_INFO: `/v3/projects/96d3221aafc248b7817b5069bc94bdfc/users/7bd770f3a6d1460ca386dabbb852f2a7/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.762132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d3221aafc248b7817b5069bc94bdfc, user_id=7bd770f3a6d1460ca386dabbb852f2a7, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.764876 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.775858 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1423/2836] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:58:58 2022] PUT /identity/v3/projects/96d3221aafc248b7817b5069bc94bdfc/users/7bd770f3a6d1460ca386dabbb852f2a7/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:58:58.787399 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.787590 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.787889 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.814417 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] MFA Rules not processed for user `7bd770f3a6d1460ca386dabbb852f2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:58:58.815756 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:58.888176 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1414/2837] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:58:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:58:58.899223 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:58.901272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:58:58.963041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f2f7f-69f1-4e06-b699-e7901dd33091 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:58.967848 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:58.968482 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:58.968759 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:58.969026 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:58.979271 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:58.980732 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:58.990512 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1424/2838] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:58:59.072053 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:58:59.082357 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26b3e6-7a9c-46e2-80aa-d47f85d04579 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:58:59.086430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:58:59.087068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:58:59.087344 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:58:59.087660 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:58:59.149186 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:58:59.150625 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a2169-f61c-45de-90d1-01920a7196a0 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:58:59.160432 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1415/2839] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:58:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:03.271085 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:03.335217 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f279b-174a-4290-b93f-e3a29d41c71c service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:03.340754 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:03.341625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:03.341898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:03.342163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] PATH_INFO: `/v3/users/121c5747a0a040b7a27f0d43ec2efc2d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:03.343402 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121c5747a0a040b7a27f0d43ec2efc2d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:03.345310 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:03.394181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121c5747a0a040b7a27f0d43ec2efc2d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.405280 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121c5747a0a040b7a27f0d43ec2efc2d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.411720 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121c5747a0a040b7a27f0d43ec2efc2d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.412397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121c5747a0a040b7a27f0d43ec2efc2d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.420564 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121c5747a0a040b7a27f0d43ec2efc2d'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.426578 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1425/2840] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:03 2022] DELETE /identity/v3/users/121c5747a0a040b7a27f0d43ec2efc2d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:03.431289 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:03.431809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:03.431908 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:03.449457 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:03.450649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:03.516266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1416/2841] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:03.530928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:03.532447 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:03.597269 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44296e4-84a8-4eff-9b57-a077af965c26 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:03.601316 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:03.601987 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:03.602266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:03.602532 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:03.611485 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:03.612928 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:03.622087 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1426/2842] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:03.912611 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:03.914180 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:03.927141 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16632abf-541a-4e6e-b4cd-b189226ec03e None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:03.933028 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:03.933962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:03.934227 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:03.934515 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] PATH_INFO: `/v3/projects/94d58d0689814379afbef301dc521068` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:03.936025 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d58d0689814379afbef301dc521068)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:03.937956 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:03.987363 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d58d0689814379afbef301dc521068', 'request_id': 'req-7e6ff72b-581a-427b-8b3b-4e5c29878367'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.992662 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d58d0689814379afbef301dc521068', 'request_id': 'req-7e6ff72b-581a-427b-8b3b-4e5c29878367'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:03.998822 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d58d0689814379afbef301dc521068', 'request_id': 'req-7e6ff72b-581a-427b-8b3b-4e5c29878367'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.012669 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] The token cache is being invalidate because project 94d58d0689814379afbef301dc521068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:04.012949 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.013617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.015226 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1417/2843] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:03 2022] DELETE /identity/v3/projects/94d58d0689814379afbef301dc521068 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:04.019294 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.028891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e4b546-5516-4afc-9ad8-f584a69b4a41 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.095904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.096790 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.097068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.097345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] PATH_INFO: `/v3/users/7bd770f3a6d1460ca386dabbb852f2a7` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.098607 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd770f3a6d1460ca386dabbb852f2a7)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.100711 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.158371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd770f3a6d1460ca386dabbb852f2a7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.170324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd770f3a6d1460ca386dabbb852f2a7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.177440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd770f3a6d1460ca386dabbb852f2a7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.178124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd770f3a6d1460ca386dabbb852f2a7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.186542 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-4a9c1799-84e3-42f4-9869-10bf67bc4435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd770f3a6d1460ca386dabbb852f2a7'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.192722 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1427/2844] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:04 2022] DELETE /identity/v3/users/7bd770f3a6d1460ca386dabbb852f2a7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:04.460978 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.462601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:04.477677 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ff72b-581a-427b-8b3b-4e5c29878367 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.533539 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.534409 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.534688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.534958 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] PATH_INFO: `/v3/projects/96d3221aafc248b7817b5069bc94bdfc` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.536178 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d3221aafc248b7817b5069bc94bdfc)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.538131 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.586487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d3221aafc248b7817b5069bc94bdfc', 'request_id': 'req-acf52a02-198e-4ee8-9238-c30c368994e0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.592946 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d3221aafc248b7817b5069bc94bdfc', 'request_id': 'req-acf52a02-198e-4ee8-9238-c30c368994e0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.599924 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d3221aafc248b7817b5069bc94bdfc', 'request_id': 'req-acf52a02-198e-4ee8-9238-c30c368994e0'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.619099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] The token cache is being invalidate because project 96d3221aafc248b7817b5069bc94bdfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:04.619439 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.620437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-acf52a02-198e-4ee8-9238-c30c368994e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:04.622696 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1418/2845] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:04 2022] DELETE /identity/v3/projects/96d3221aafc248b7817b5069bc94bdfc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:04.628007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.628515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.628515 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.647590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:04.648744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:04.709027 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1428/2846] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:04.716962 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.717305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.717610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.738560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:04.739786 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:04.749913 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1419/2847] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:04.754339 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.764393 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc1d70-2772-4850-b80b-f3a787bf7dd1 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.769952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.770610 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.770908 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.771181 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.771958 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:59:04.772254 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.773889 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.785745 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1429/2848] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:59:04.790099 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.800320 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee05e30-5f0e-469f-8882-0698a3a5920c None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.806728 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.807405 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.807699 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.807974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.808661 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.810586 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.842309 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1420/2849] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:59:04 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:04.847114 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.860406 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efd0a0-fbe7-4d92-8e62-ef830060b791 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.920483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.921088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.921366 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.921660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.922322 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.924312 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.947493 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1430/2850] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:59:04 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:04.951751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.962001 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087092d9-eac6-4752-8783-e4345eb2d4c7 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:04.966845 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:04.967584 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:04.967864 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:04.968160 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:04.968880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:04.970491 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:04.981667 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1421/2851] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:04.985674 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:04.995671 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09633c7d-c450-4bcb-991d-6366d660be07 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.000746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.001397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.001686 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.001981 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.002713 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.004354 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff25f6-8fb2-4e6c-8745-f5d8783d25e6 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.014140 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1431/2852] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:05.018460 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.028568 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d938645-8fef-4c5b-bb5c-4bd0ce5a83d1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.033256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.034145 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.034419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.034688 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] PATH_INFO: `/v3/projects/51c9588a7b33459288ae03bef97c09c1/users/1f701196032f48c6b037757651645eb2/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.049305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c9588a7b33459288ae03bef97c09c1, user_id=1f701196032f48c6b037757651645eb2, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.051980 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.066177 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1422/2853] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:59:05 2022] PUT /identity/v3/projects/51c9588a7b33459288ae03bef97c09c1/users/1f701196032f48c6b037757651645eb2/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:05.076983 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.077264 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.077539 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.104783 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] MFA Rules not processed for user `1f701196032f48c6b037757651645eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:05.106124 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:05.169611 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1432/2854] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:59:05.174886 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.243169 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e75099-69a9-4132-8883-315f62cbb69b admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.250575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.251331 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.251652 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.251927 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.252615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.254571 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.282683 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1423/2855] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:59:05 2022] POST /identity/v3/projects => generated 381 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:05.286810 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.298295 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6e173-f275-4376-9290-3cbe40d0c9f6 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.356591 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.357259 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.357536 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.357915 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.358619 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.360567 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.382454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1433/2856] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:59:05 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:05.386755 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.397305 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b42af-5f96-41f2-b16f-6bddcb03b621 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.402598 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.403252 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.403560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.403948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.404718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.406317 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.416880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1424/2857] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:05.421081 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.431579 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75795f-e762-4f28-801b-48f49eb3c174 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.437041 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.438008 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.438282 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.438549 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] PATH_INFO: `/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c/users/4ccb5746407045e7a343f8e583aa9738/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.454088 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac7fdfe9c004e5381ee2bcbd49b835c, user_id=4ccb5746407045e7a343f8e583aa9738, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.456778 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.473445 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1434/2858] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:59:05 2022] PUT /identity/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c/users/4ccb5746407045e7a343f8e583aa9738/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:05.477419 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.489391 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9edc6-765a-40e2-a563-9d0784d4aa5a admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.550310 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.550974 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.551256 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.551563 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.552282 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.553891 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a32fee-1ca6-43bf-82e4-2ecbbeac106e admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.563768 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1425/2859] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:59:05.568160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.579032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc0862-ca9d-4563-a3d4-0300dcc162fa admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.583935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.584851 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.585132 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.585392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] PATH_INFO: `/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c/users/4ccb5746407045e7a343f8e583aa9738/roles/1af302468b924833a9aea028857eac8d` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.587511 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac7fdfe9c004e5381ee2bcbd49b835c, user_id=4ccb5746407045e7a343f8e583aa9738, role_id=1af302468b924833a9aea028857eac8d)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.590188 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.600648 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1435/2860] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:59:05 2022] PUT /identity/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c/users/4ccb5746407045e7a343f8e583aa9738/roles/1af302468b924833a9aea028857eac8d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:05.611922 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.612209 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.612487 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.638702 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] MFA Rules not processed for user `4ccb5746407045e7a343f8e583aa9738`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:05.640009 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:05.706954 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1426/2861] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:05.718345 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.719918 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:05.785924 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821b59-b507-4046-bc1d-378f6682be8a admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.793256 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.794236 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.794633 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.795036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:05.805401 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:05.806835 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:05.821716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1436/2862] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:05.929495 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:05.939803 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc962c4b-84ad-4901-97b3-4c4b774b526f None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:05.944304 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:05.944948 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:05.945610 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:05.945880 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:06.002710 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:06.004109 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dde1c4-4452-44cc-b4b6-c9ec185d1ed2 service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:06.013455 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1427/2863] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:08.623054 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:08.688746 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cd88b-607f-404e-965c-af9ed8e4c018 service cinder] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:08.696952 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:08.698292 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:08.698604 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:08.698906 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] PATH_INFO: `/v3/users/1f701196032f48c6b037757651645eb2` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:08.700841 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f701196032f48c6b037757651645eb2)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:08.703533 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:08.754723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f701196032f48c6b037757651645eb2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:08.767277 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f701196032f48c6b037757651645eb2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:08.774373 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f701196032f48c6b037757651645eb2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:08.775083 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f701196032f48c6b037757651645eb2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:08.783118 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f701196032f48c6b037757651645eb2'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:08.789148 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1437/2864] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:08 2022] DELETE /identity/v3/users/1f701196032f48c6b037757651645eb2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:08.793914 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:08.794431 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:08.794534 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:08.811907 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:08.813095 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:08.879112 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1428/2865] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 04 21:59:08.889504 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:08.891198 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:08.952563 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4755-80f3-4559-9b58-666a6d9371c3 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:08.957251 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:08.957929 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:08.958208 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:08.958479 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:08.968589 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:08.970032 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:08.979590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1438/2866] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:09.256617 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:09.258890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:09.271751 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b126f367-9026-4155-bc49-c40aabad0037 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:09.277634 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:09.278512 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:09.278793 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:09.279058 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] PATH_INFO: `/v3/projects/51c9588a7b33459288ae03bef97c09c1` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:09.280350 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c9588a7b33459288ae03bef97c09c1)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:09.282437 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:09.333087 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c9588a7b33459288ae03bef97c09c1', 'request_id': 'req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.339081 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c9588a7b33459288ae03bef97c09c1', 'request_id': 'req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.347851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c9588a7b33459288ae03bef97c09c1', 'request_id': 'req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.362726 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] The token cache is being invalidate because project 51c9588a7b33459288ae03bef97c09c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:09.363010 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.363735 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.365355 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1429/2867] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:09 2022] DELETE /identity/v3/projects/51c9588a7b33459288ae03bef97c09c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:09.369470 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:09.379042 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074081a5-7840-442d-8c3b-62427e784a66 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:09.439744 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:09.440550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:09.440832 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:09.441107 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] PATH_INFO: `/v3/users/4ccb5746407045e7a343f8e583aa9738` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:09.442361 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccb5746407045e7a343f8e583aa9738)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:09.444363 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:09.490820 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccb5746407045e7a343f8e583aa9738'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.502776 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccb5746407045e7a343f8e583aa9738'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.509474 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccb5746407045e7a343f8e583aa9738'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.510162 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccb5746407045e7a343f8e583aa9738'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.518509 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-42ce5f45-2f8b-4c8d-8214-36070970272f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccb5746407045e7a343f8e583aa9738'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:09.524931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1439/2868] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:09 2022] DELETE /identity/v3/users/4ccb5746407045e7a343f8e583aa9738 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:10.069690 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.071890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:10.085268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7a44-fa2d-4d9e-8b13-df5b5456c57d admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.145890 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.146761 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.147026 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.147295 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] PATH_INFO: `/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.148575 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac7fdfe9c004e5381ee2bcbd49b835c)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.150485 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.197797 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac7fdfe9c004e5381ee2bcbd49b835c', 'request_id': 'req-7bee9d01-b802-47ee-9122-c2c6986d3bac'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:10.203371 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac7fdfe9c004e5381ee2bcbd49b835c', 'request_id': 'req-7bee9d01-b802-47ee-9122-c2c6986d3bac'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:10.210566 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac7fdfe9c004e5381ee2bcbd49b835c', 'request_id': 'req-7bee9d01-b802-47ee-9122-c2c6986d3bac'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:10.224635 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] The token cache is being invalidate because project 5ac7fdfe9c004e5381ee2bcbd49b835c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:10.224921 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:10.225606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-7bee9d01-b802-47ee-9122-c2c6986d3bac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:10.227266 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1430/2869] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:10 2022] DELETE /identity/v3/projects/5ac7fdfe9c004e5381ee2bcbd49b835c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:10.233012 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.233531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.233531 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.252029 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:10.253200 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:10.314507 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1440/2870] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:10.323063 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.323347 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.323649 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.343315 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:10.344556 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:10.353909 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1431/2871] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:10.358347 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.368625 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01032cc-5945-45dc-ad16-8787e68dc211 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.374642 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.375301 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.375612 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.375882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.376645 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:59:10.376945 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.378602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.390392 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1441/2872] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:59:10.394779 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.404075 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55347e6-c106-482b-84f1-cdc4417481ea None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.409601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.410244 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.410524 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.410802 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.411531 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.413446 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.445983 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1432/2873] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:59:10 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:10.448376 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.460379 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b0c10-ec63-4e1d-b157-d4cac842d092 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.517553 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.518163 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.518448 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.518725 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.519443 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.521440 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.541882 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1442/2874] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:59:10 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:10.545879 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.556546 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cd52e-4bd9-487d-85a1-0c693db61488 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.562313 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.562979 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.563258 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.563577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.564523 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.566538 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.581090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1433/2875] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 04 21:59:10.582319 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.592815 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b54dd1-62cf-4ed7-a5ee-bc10de8c8fed admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.598099 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.598853 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.599175 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.599516 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.600420 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.602160 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29ee73-179e-4a66-97a3-277f69fb0df0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.618442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1443/2876] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:10.619945 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.630284 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6875776e-0697-40ff-9914-7b4c9f0666a1 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.635068 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.635988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.636272 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.636545 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] PATH_INFO: `/v3/projects/91d4fcd66c424395a2eccc21f6d29f73/users/c6ab9525c4ba444395dce2ddf096417a/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.652069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d4fcd66c424395a2eccc21f6d29f73, user_id=c6ab9525c4ba444395dce2ddf096417a, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.654695 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.668988 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1434/2877] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:59:10 2022] PUT /identity/v3/projects/91d4fcd66c424395a2eccc21f6d29f73/users/c6ab9525c4ba444395dce2ddf096417a/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:10.680602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.681047 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.681451 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.715927 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] MFA Rules not processed for user `c6ab9525c4ba444395dce2ddf096417a`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:10.717149 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:10.779823 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1444/2878] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:10.794277 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:10.796307 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:10.878973 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c297e-71df-4780-8bab-62d2a9c6b429 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:10.883237 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41e2d642d4db4a7f92fd6b45ebb5f8f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:10.883911 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:10.884191 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:10.884458 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:10.893129 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:10.894615 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c9991-ccb4-43c4-ac3a-5134cbc47158 service glance] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:10.904199 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1435/2879] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:32.825386 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:32.894283 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2be30-7a94-49d3-aca4-bc0c67c58a64 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:32.899935 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:32.900813 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:32.901092 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:32.901365 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] PATH_INFO: `/v3/users/c6ab9525c4ba444395dce2ddf096417a` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:32.902602 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ab9525c4ba444395dce2ddf096417a)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:32.904574 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:32.960550 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ab9525c4ba444395dce2ddf096417a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:32.972893 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ab9525c4ba444395dce2ddf096417a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:32.980483 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ab9525c4ba444395dce2ddf096417a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:32.981297 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ab9525c4ba444395dce2ddf096417a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:32.991238 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ab9525c4ba444395dce2ddf096417a'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.000371 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1445/2880] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:32 2022] DELETE /identity/v3/users/c6ab9525c4ba444395dce2ddf096417a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:33.005975 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.006498 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.006597 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.027851 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:33.029069 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:33.091394 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1436/2881] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:33.103093 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.105458 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:33.177076 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58638efc-0b69-41bf-a309-7be8a6d75b4d admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.181068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.181712 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.181992 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.182266 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.192397 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.193840 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6693a8-9ae9-4f0c-8afe-9958439101f4 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.204109 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1446/2882] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:33.490703 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.492606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:33.506116 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067aada-9f7f-4cb9-959e-0759ea119a68 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.510966 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.511873 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.512146 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.512416 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] PATH_INFO: `/v3/projects/91d4fcd66c424395a2eccc21f6d29f73` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.513606 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d4fcd66c424395a2eccc21f6d29f73)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.515519 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.563179 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d4fcd66c424395a2eccc21f6d29f73', 'request_id': 'req-5527ad97-0656-4c42-a0fe-0041172059c3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.571442 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d4fcd66c424395a2eccc21f6d29f73', 'request_id': 'req-5527ad97-0656-4c42-a0fe-0041172059c3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.577865 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d4fcd66c424395a2eccc21f6d29f73', 'request_id': 'req-5527ad97-0656-4c42-a0fe-0041172059c3'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.590762 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] The token cache is being invalidate because project 91d4fcd66c424395a2eccc21f6d29f73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:33.591047 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.591663 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-5527ad97-0656-4c42-a0fe-0041172059c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:33.593358 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1437/2883] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:33 2022] DELETE /identity/v3/projects/91d4fcd66c424395a2eccc21f6d29f73 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:33.598628 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.598909 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.599182 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.617964 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:33.619159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:33.677857 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1447/2884] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:33.737098 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.737477 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.737601 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.757408 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:33.758604 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:33.767345 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1438/2885] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:33.772068 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.783007 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2d75ea-34bf-4f93-9091-25313549153d None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.789272 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.789931 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.790207 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.790476 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.791214 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80011) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 04 21:59:33.791551 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.793156 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.805587 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1448/2886] 10.222.0.23 () {58 vars in 1152 bytes} [Wed May 4 21:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 04 21:59:33.809929 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.819104 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02239c7d-2ae5-4e14-8be0-266b694b2f6a None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.824516 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.825148 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.825425 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.825689 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.826387 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.828329 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.855659 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1439/2887] 10.222.0.23 () {60 vars in 1152 bytes} [Wed May 4 21:59:33 2022] POST /identity/v3/projects => generated 397 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:33.859809 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.869842 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b6801-b947-45cd-8173-ca6919737342 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.925788 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.926454 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.926737 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.926997 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] PATH_INFO: `/v3/users` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.927723 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.929660 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.952590 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1449/2888] 10.222.0.23 () {60 vars in 1143 bytes} [Wed May 4 21:59:33 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 04 21:59:33.957055 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:33.967805 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b44ce-9c4c-4a85-a725-445a82030325 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:33.972536 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:33.973201 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:33.973479 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:33.973737 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:33.974472 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:33.976134 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:33.987430 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1440/2889] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:33.991749 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:34.003220 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96718f0-35d2-47a3-b594-4651858856cb admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:34.009421 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:34.010157 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:34.010438 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:34.010716 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:34.011872 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:34.014423 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f70822-5649-45a2-ad9e-55db935af0c1 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:34.031159 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1450/2890] 10.222.0.23 () {58 vars in 1121 bytes} [Wed May 4 21:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 04 21:59:34.035887 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:34.046321 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb7ce7-ec3b-4a33-b1fe-c8bf2c6ba3b0 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:34.051360 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:34.052286 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:34.052559 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:34.052834 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] PATH_INFO: `/v3/projects/6524a0dfcb014dee9f0462e88a4a8a61/users/4c55d3b0230b4e7595a4f7dea1470366/roles/1461cca390e245e2ad8f81a72e0dc6d3` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:34.067564 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6524a0dfcb014dee9f0462e88a4a8a61, user_id=4c55d3b0230b4e7595a4f7dea1470366, role_id=1461cca390e245e2ad8f81a72e0dc6d3)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:34.070594 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:34.085878 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1441/2891] 10.222.0.23 () {60 vars in 1482 bytes} [Wed May 4 21:59:34 2022] PUT /identity/v3/projects/6524a0dfcb014dee9f0462e88a4a8a61/users/4c55d3b0230b4e7595a4f7dea1470366/roles/1461cca390e245e2ad8f81a72e0dc6d3 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:34.096311 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] REQUEST_METHOD: `POST` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:34.096571 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:34.096904 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:34.123491 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.auth.core [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] MFA Rules not processed for user `4c55d3b0230b4e7595a4f7dea1470366`. Rule list: `[]` (Enabled: `True`). {{(pid=80011) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:34.124676 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:34.189969 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1451/2892] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:34.206577 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:34.208955 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:34.272017 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68945c8-c78d-408d-8034-11fb90ebd348 admin admin] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:34.276404 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '93f8c6e46f6d4cc8a3364bfa3e6b93d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:34.277090 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] REQUEST_METHOD: `GET` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:34.277378 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:34.277645 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:34.286473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:34.287947 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf405c-ca48-4c02-b5d2-e034bdbc17ab service cinder] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:34.296718 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1442/2893] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:34 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:43.440779 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:43.513558 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6299b-8f0f-4d08-93ec-9f101d75b931 None None] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:43.518546 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:43.519459 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:43.519742 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:43.520036 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] PATH_INFO: `/v3/users/4c55d3b0230b4e7595a4f7dea1470366` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:43.521260 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c55d3b0230b4e7595a4f7dea1470366)` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:43.523265 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:43.572898 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c55d3b0230b4e7595a4f7dea1470366'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:43.585427 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c55d3b0230b4e7595a4f7dea1470366'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:43.592382 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c55d3b0230b4e7595a4f7dea1470366'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:43.593206 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c55d3b0230b4e7595a4f7dea1470366'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:43.604267 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.notifications [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c55d3b0230b4e7595a4f7dea1470366'} {{(pid=80011) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:43.614634 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1452/2894] 10.222.0.23 () {58 vars in 1223 bytes} [Wed May 4 21:59:43 2022] DELETE /identity/v3/users/4c55d3b0230b4e7595a4f7dea1470366 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 21:59:43.620651 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] REQUEST_METHOD: `POST` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:43.621137 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:43.621268 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:43.639303 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.auth.core [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] MFA Rules not processed for user `f6c818d1963e4410bafbf00912c084aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80010) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 04 21:59:43.640526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:43.706426 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1443/2895] 10.222.0.23 () {58 vars in 957 bytes} [Wed May 4 21:59:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 04 21:59:43.716442 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:43.718110 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:43.777268 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a1e1c-4509-44de-826f-75a54df8c8f0 admin admin] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:43.781724 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3aa6a22bd7c49679c84f824f43aca30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:43.782383 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:43.782662 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:43.782933 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:43.793125 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:43.794569 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:43.805058 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1453/2896] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 21:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 04 21:59:44.091014 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] Authenticating user token {{(pid=80010) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 21:59:44.092526 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.fernet_utils [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80010) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 21:59:44.106682 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe1642-242d-4376-b353-4d84674a9c10 None None] Validating token access rules against request {{(pid=80010) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 21:59:44.111989 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6c818d1963e4410bafbf00912c084aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '69a58d85914b42b5b2db98febd6721c4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80010) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 21:59:44.112938 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 21:59:44.113297 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 21:59:44.113574 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] PATH_INFO: `/v3/projects/6524a0dfcb014dee9f0462e88a4a8a61` {{(pid=80010) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 21:59:44.114791 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6524a0dfcb014dee9f0462e88a4a8a61)` {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 21:59:44.116744 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] RBAC: Authorization granted {{(pid=80010) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 21:59:44.162809 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6524a0dfcb014dee9f0462e88a4a8a61', 'request_id': 'req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:44.168016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6524a0dfcb014dee9f0462e88a4a8a61', 'request_id': 'req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:44.173982 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6524a0dfcb014dee9f0462e88a4a8a61', 'request_id': 'req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95'} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:44.186560 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] The token cache is being invalidate because project 6524a0dfcb014dee9f0462e88a4a8a61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80010) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 04 21:59:44.186839 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:44.187473 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: DEBUG keystone.notifications [None req-bedbdaf0-610e-41b5-903d-4c1cf0ef7b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80010) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 04 21:59:44.189016 dv-cinder-836083-5-iscsi devstack@keystone.service[80010]: [pid: 80010|app: 0|req: 1444/2897] 10.222.0.23 () {58 vars in 1232 bytes} [Wed May 4 21:59:44 2022] DELETE /identity/v3/projects/6524a0dfcb014dee9f0462e88a4a8a61 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 04 22:03:14.505727 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] Authenticating user token {{(pid=80011) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 04 22:03:14.507309 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:14.663324 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d08ab-db71-4441-982f-e543ad2c5317 service neutron] Validating token access rules against request {{(pid=80011) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 04 22:03:14.733011 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4018fbf31d0421d87101f4c771d8017', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3bcaa95cbf24f389fd93a17969df230', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80011) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 04 22:03:14.733699 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] REQUEST_METHOD: `GET` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 04 22:03:14.733976 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] SCRIPT_NAME: `/identity` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 04 22:03:14.734246 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80011) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 04 22:03:14.736315 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.fernet_utils [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80011) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 04 22:03:14.747565 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 04 22:03:14.749113 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc46ca-ba81-47f9-8093-66babcb72168 service placement] RBAC: Authorization granted {{(pid=80011) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 04 22:03:14.758891 dv-cinder-836083-5-iscsi devstack@keystone.service[80011]: [pid: 80011|app: 0|req: 1454/2898] 10.222.0.23 () {60 vars in 1365 bytes} [Wed May 4 22:03:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)